Hi Community, I am exploring the RealtimeToOffline Minion Task. I wanted to confirm if the upload of converted offline segments and update of

watermark metadata

is atomic? I do see the segment replacement protocol but I think it doesn't come into picture for RealtimeToOfflineTask but for Merge task.

Segment uploads are idempotent, so you will never end up with duplicate data if that is your concern. Watermark is updated only after upload.

@Mayank: Thanks for your reply. Yes, my concern is around duplicate data. Does the Segment naming convention guarantee idempotency?

Yes