We are loading offline tables with minion jobs !! How can we push segments with same names ? Same file names wont be picked right!! How to do it can you share !!
m
Mayank
12/02/2025, 6:45 PM
Check docs for segmentName generator spec
👍 1
r
RANJITH KUMAR
12/02/2025, 6:51 PM
Is there a way to configure this in table config ?
m
Mayank
12/02/2025, 6:53 PM
In ingestion spec. Note though, this is typically for REFRESH use cases where you want to REFRESH the entire table with each push.
r
RANJITH KUMAR
12/02/2025, 6:57 PM
REFRESH is loading everything from input directory irrespective of it has loaded those files earlier, this is causing duplicate issue.
m
Mayank
12/02/2025, 6:59 PM
But you want to overwrite, so picking the right naming spec and refresh will do that