Hello, I'm runnning Pinot in K8s and I have a job ...
# general
h
Hello, I'm runnning Pinot in K8s and I have a job that creates my table, my schema and another job that does the ingestion from a GCS storage. This last job creates segments and store them in a GCS bucket. Is there a way for later runs to load these segments directly from the folder without recreating them ?
m
You can choose the job type that only does the push https://docs.pinot.apache.org/configuration-reference/job-specification
h
that works well, thanks !
m
You probably want to use metadata+uri push since you are using deepstore. This way only metadata will be pushed to controller, and servers will download it from deepstore
h
So should I use SegmentUriPush or SegmentMetadataPush as Jobtype ?
m
Metadata push
h
Ok Thanks