is generally pointing to …where? Deep Store? Will Pinot download the segments from this place?
r
Rong R
10/14/2022, 8:51 PM
AFAIK this config in segment generation job spec is used on 2 places
• for segment generation job runner that actually converts into a segment file: this config is where the generated segments being stored (temporarily) before uploading to cluster
• for segment push job runner this is the Dir use to construct the list of segmentUri to be pushed to cluster.
Rong R
10/14/2022, 8:51 PM
ingestion job spec CANNOT configure where deep store is. that's cluster config and is not sth an individual ingestion job can change