hello, I am currently implementing the DatahubSpar...
# ingestiond
delightful-barista-90363
09/06/2022, 7:56 PMhello, I am currently implementing the DatahubSparkListener. We have a token setup, but it gets logged in the spark submit command. Is there anyway to hide the token or configure the token through environment variables?
h
helpful-optician-78938
09/06/2022, 9:30 PMHi @dazzling-judge-80093, could you help answer this question?
helpful-optician-78938
09/06/2022, 9:38 PMHi @delightful-barista-90363, could you try if the following syntax works
"spark.datahub.rest.token" = ${?DATAHUB_TOKEN},DATAHUB_TOKENd
delightful-barista-90363
09/06/2022, 10:05 PMI can try that out
delightful-barista-90363
09/09/2022, 8:54 PMHey, could not get this to work since we are using subprocess in python (without shell)