Is there a way to enable/disable individual segmen...
# getting-started
t
Is there a way to enable/disable individual segments?
k
@User can you elaborate on what’s the use case ?
t
I want to batch ingest data on a per day basis, but only enable the most recent day once it has finished ingesting. Each day would end up consisting of many segments. Is there a suggested method of doing this?
k
Hmm there is no such API to enable/disable individual segments, only deleting a segment or multiple(JSON array) if you have a list. Just curious why table only needs to have data for most recent day and not others ? If older days data is not needed ever then simply configure the
retention*
settings in the table appropriately: https://docs.pinot.apache.org/configuration-reference/table#top-level-fields cc @User
m
@User the recommended way of doing so is to have time filter in the query to explicitly select the time range. You can additional set retention to auto purge/delete older segments.
t
Thanks!
To clarify, the table still needs the data for the older days. I just want to enable the latest date once all the segments have finished ingesting