Hello everyone, Is it possible to generate fixed segment names with sequenceId appended to them? I have an input folder with multiple csv files in it. I want to run an ingestion job to import them. I am trying to use backfill data feature to truncate my table. I want to replace those segments with another data set in the future and data doesn't have a time column actually. It seems that segment names are playing a role in replacing segments. That's why i am asking about fixed name plus sequenceId. Thanks in advance 🙏

I think setting the table as REFRESH table will do that

Thank you @Mayank it did the work. Would it be possible to do this on a table with timeColumn? If I wanted to discard all the old segments and import fresh data.

Hmm do you want to do it on a regular basis or once in a while ?

it would be nice to do it on a regular basis. I would like to keep daily data in my table.

If you want time column and also want append + refresh capability, then use APPEND table. Have your data date partitioned so you can backfill specific days as you need.

thank you @Mayank