Should they match for a successful replacement of the segments? If yes, how do we configure the naming in ``RealtimeToOfflineSegmentsTask` /

MergeRollupTask

?

@Sukesh Boggavarapu Currently, there’s no good way to achieve the segment replacement (unless you manually make the same segment names) for data that are processed with realtimetooffline/mergerollup task. We are working on introducing segment backfill based on

time window

. With this, you can reason about the mapping from your source to the data in Pinot table. e.g. start_date=07/27/2022 end_date=07/28/2022 input files -> replace all data in Pinot table between 07/27-07/28 with input files

Hmm..So the option right now is not to use the RTO/Mergeroll up tasks I guess then? Instead of going with a hybrid approach, we should have a real time table for 1 day and have an offline table that gets populated through batch ingestion for previous days right?

Example of manually replacing a segment here just in case - https://dev.startree.ai/docs/pinot/recipes/backfill

Got it. Thanks. But what if the data is large that there will be multiple segments?

yeh then you would have to replace each of the segments separately