Hello, I have a general question for you. Did anybody ever used gcs as PinotFS through a proxy with spark ingestion? It seems like this library used in
pinot-gcs
doesn't support proxies and currently my spark workers can't connect to gcs. I've already tried to set
Copy code
-Dhttps.proxyHost -Dhttps.proxyPort
but they affect only the driver. Thanks
m
Mayank
09/23/2022, 2:02 PM
I know of examples where ADLS with proxy on Azure was used. Do you know if newer version of the library may support it?