Hey 👋 , I am new to Apache Pinot and playing around with it atm. I found that listing the consumer group on my kafka broker doesn’t list pinot consumer.

group.id

I see on the pinot server logs is

null

. Is there a config I could set to have an assigned group id? I tried setting

stream.kafka.consumer.prop.group.id

on the

streamConfigs

, but it didn’t work. Thanks

Pinot manages the kafka offsets itself; so it does not use a consumer group nor should you have auto commit enabled. This allows pinot to do things like consume the same partition on 2 separate servers. This wouldn't work if we were using a consumer group.

like consume the same partition on 2 separate servers

Interesting. And this is done for replication?

Yes.

thanks 👍