coco
05/12/2022, 8:32 AMsegment.name.prefix : normalizedDate
exclude.sequence.id : false
-- input data file
<hdfs://data/pinot_poc/input_table/yyyymmdd=20220512/data-file-0.parq>
<hdfs://data/pinot_poc/input_table/yyyymmdd=20220512/data-file-1.parq>
<hdfs://data/pinot_poc/input_table/yyyymmdd=20220512/data-file-2.parq>
-- pinot segment
<hdfs://data/pinot_poc/controller/segments/pinot_table/batch_2022-05-12_2022-05-12_0>
<hdfs://data/pinot_poc/controller/segments/pinot_table/batch_2022-05-12_2022-05-12_1>
<hdfs://data/pinot_poc/controller/segments/pinot_table/batch_2022-05-12_2022-05-12_2>
------------------------------
If I redo the batch and the data file is reduced to two:
-- input data file
<hdfs://data/pinot_poc/input_table/yyyymmdd=20220512/data-file-0.parq>
<hdfs://data/pinot_poc/input_table/yyyymmdd=20220512/data-file-1.parq>
segment.name: fixed
If I have to use the 'segment.name:fixed' setting, how can I gracefully delete the segment 'batch_2022-05-12_2022-05-12_2'?Ken Krugler
05/12/2022, 5:35 PMNeha Pawar
coco
05/16/2022, 12:40 PMKen Krugler
05/16/2022, 4:03 PM