https://pinot.apache.org/ logo
m

Mayank

08/03/2020, 3:55 PM
Controller initializes the PinotFs implementation based on the uri, IIRC. So using local dir will instantiate localFs. I am hoping http:// might pick up HDFS, if not, we should fix.
y

Yash Agarwal

08/03/2020, 3:56 PM
Http:// or hdfs:// ?
m

Mayank

08/03/2020, 3:56 PM
http as well
y

Yash Agarwal

08/03/2020, 3:57 PM
I am sorry. I didnt get what i should do. What would the config fir controller look like?
m

Mayank

08/03/2020, 3:58 PM
deeps-storage uri path (in your case http://...)
y

Yash Agarwal

08/03/2020, 3:59 PM
Let me try and get back.
m

Mayank

08/03/2020, 3:59 PM
If it doesn't, check how
PinotFSFactory
initializes pinotFS
y

Yash Agarwal

08/03/2020, 4:47 PM
So the httpsFS is getting picked up no problem.
in the controller.
It is downloading the Https File to the controller dataDir.
and then pushing the downloaded url. i.e. the controller url as the zkDownloadUri to servers.