https://pinot.apache.org/ logo
g

Girish bhat m

03/10/2021, 6:09 AM
<!here> In the class org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.init(SegmentGenerationJobSpec) method below statements throws error
Copy code
_inputDirFS = PinotFSFactory.create(_inputDirURI.getScheme());
if the scheme is not loaded and in the run method schemes are registered . Isn't it good way to add method like below in the init method of the Jobrunner ?
Copy code
void registerSchemsIfNotRegistered(_spec)
k

Kishore G

03/10/2021, 6:21 AM
@Xiang Fu what do you think?
x

Xiang Fu

03/10/2021, 6:42 AM
this should be auto loaded when you configure the fs properties
the pinot fs and corresponded scheme should be registered in the
PinotFSSpec
2 Views