Controller initializes the PinotFs implementation based on the uri, IIRC. So using local dir will instantiate localFs. I am hoping http:// might pick up HDFS, if not, we should fix.
y
Yash Agarwal
08/03/2020, 3:56 PM
Http:// or hdfs:// ?
m
Mayank
08/03/2020, 3:56 PM
http as well
y
Yash Agarwal
08/03/2020, 3:57 PM
I am sorry. I didnt get what i should do. What would the config fir controller look like?
m
Mayank
08/03/2020, 3:58 PM
deeps-storage uri path (in your case http://...)
y
Yash Agarwal
08/03/2020, 3:59 PM
Let me try and get back.
m
Mayank
08/03/2020, 3:59 PM
If it doesn't, check how
PinotFSFactory
initializes pinotFS
y
Yash Agarwal
08/03/2020, 4:47 PM
So the httpsFS is getting picked up no problem.
in the controller.
It is downloading the Https File to the controller dataDir.
and then pushing the downloaded url. i.e. the controller url as the zkDownloadUri to servers.