We are planning to migrate Pinot to a new kafka cluster. Our plan is to point Pinot to the new endpoints, and update

segment.realtime.startOffset

of each CONSUMING segment to 0, and restart the servers. Do we need to take care of anything else?

You can set it to smallest

Hi Mayank, thanks for the reply. What do you mean by smallest? We set it to 0, it worked. However, we have a different issue in prod now. We have a total of 22k segments, and although we’ve to update the metadata of only |partitions| segments (< 64), it would require us to scroll up and down the screen for each segment many, many times. Doing this manually is not feasible. An admin command is definitely required for this use-case. An issue was opened for this but not sure what the current status is // @User @User

Hey @User I was referring to

"stream.kafka.consumer.prop.auto.offset.reset": "smallest"

.

This was already present in the config but doesn’t work. We had to set

segment.realtime.startOffset

to 0.