Please, can someone clarify when a realtime segment becomes "OFFLINE"? Is there any way to change it back to CONSUMING or ONLINE?

Check the logs.. if the stream consumer goes down or throws errors indefinitely, Pinot sets it to offline

Thanks Kishore, I see in the logs the consumer is recreated every n seconds because there isn't traffic in this env. I'll check if there is a lyric that I can use to monitor this

Yeah.. we recently added a feature to disable recreating consumer if there are no events..

We started using Kafka LLC but now we are evaluating the high level consumer

Llc is the right approach.. high level is old and works well only at small scale

Good to know 👍

to give some more context we have a segment which is offline on server 0 - when hitting the reset API it is staying stuck in OFFLINE - any reason that may happen - i don't see anything interesting in the logs

Is it offline in the ideal state or just the external view?

its offline in both

if it’s offline in ideal state, i believe reset wont help. But the periodic task https://docs.pinot.apache.org/basics/components/controller#realtimesegmentvalidationmanager should fix it automatically. If it’s not, you might want to look at lead controller logs for any info about repairing that segment and why it’s not happenning

thanks Neha will take a look - what would move it to offline in idealstate?

typically a stream transient error. the consuming segment will mark itself offline if it sees a certain number of consecutive exceptions. then the periodic task will fix it within the next hour and make it try again