Hi getting deeper in my purge process dev many thanks to the pinot team for the awesome support and code quality 😉 . Is there any way to upload a realtime segment ? Like purging it and refreshing it ? I do not really inderstand why this is not possible if the segment is not consuming 😕 And I’m a bit surprised of the API getting an OFFLINE table for the uploadProcess instead my original type REALTIME

at the moment you can't replace a real-time segment, but I think someone might be working on it. @User will have more info.

I can see it’s replacing my REALTIME to OFFLINE for the table name but don’t know where 😕

at the moment you can only replace offline segments, real-time ones won't work

Not really it complains about segment non existing (Still in realTime Table )`org.apache.pinot.common.exception.HttpErrorStatusException: Got error status code: 410 (Gone) with reason: "Cannot refresh non-existing segment, aborted uploading segment: actions__0__0__20220405T0951Z of table: actions_OFFLINE" while sending request: http://127.0.0.1:9000/segments?enableParallelPushProtection=true&tableName=actions`

There's a simple example showing one way to do that here --> https://dev.startree.ai/docs/pinot/recipes/backfill

Yes already use it 😉

ah cool

@Mark Needham the segment backfill task, can it be done as an adhoc task in minion. I try to avoid using the jobspecs.yaml as it will require me to run it at the instance where pinot runs.