Apache Pinot

does anyone know how we can  set consumer group name in kafka stream ingestion?

<@U0481GNN37A> are you using high level consumer in Pinot? `consumer.type`  = `high` ?
if so, you can set it with config key `group.id`

It is not generally recommended that you use high / stream level kafka consumer with Pinot . It has stayed around for legacy users. Is there a specific reason why would choose stream level consumption ?

I want lowlevel setting instead of high and would like to know the status of s=consumption for partitions

Got it. In low level setting, we don't use Kafka's consumer group management. Pinot manages the partition assignment and offsets.

For figuring out the consumption status - We recently added the consumer lag to the `/consumingSegmentsInfo` API. So, if you are using the latest pinot version, you should be able to see the lag per partition in the response. I am currently working on publishing this as a metric