Apache Pinot

Hey team :wave: . I'm currently in the process of writing a custom flink job which is able to atomically replace the segments for a pinot refresh table. I've been looking into the segment replacement protocol, and wanted to see if I understand this correctly.. More info in thread

So prior to uploading segments, I should call startReplaceSegments. Then after that has been called, can I then start calling uploadSegment?

I guess in this case, I should be uploading segments to some other directory/bucket (s3).

Once this is all done, do I then call endReplaceSegments? What do I do if there is a failure while uploading segments? Anything else I should know? Thank you all

This is needed for batch replacement of segments in an atomic way.. if you want to just replace one segment at a time.. you can just call upload segment

Yep exactly, I'm looking to do an atomic batch replacement