Hi Team, we are using Apache Pinot for running OLA...
# troubleshooting
p
Hi Team, we are using Apache Pinot for running OLAP queries and right now one of the table is stuck in consumer rebalance state(while pointing to a kafka topic) for last 12 hours. I tried restarting the Pinot Servers which didn't help . Can someone please suggest any steps here . These messages came in repeatedly
Copy code
[Consumer clientId=consumer-2, groupId=event_template_mapping_REALTIME_1627646764788_0] Group coordinator <*> (id: 795314267 rack: null) is unavailable or invalid, will attempt rediscovery
[Consumer clientId=consumer-2, groupId=event_template_mapping_REALTIME_1627646764788_0] Discovered group coordinator <*> (id: 795314267 rack: null)
[Consumer clientId=consumer-2, groupId=event_template_mapping_REALTIME_1627646764788_0] (Re-)joining group
And finally after 6-7 hours saw this message , which basically didn't fetch any partition .
Copy code
[Consumer clientId=consumer-4, groupId=event_template_mapping_REALTIME_1627646764788_0] Successfully joined group with generation 6
[Consumer clientId=consumer-4, groupId=event_template_mapping_REALTIME_1627646764788_0] Setting newly assigned partitions []
m
@Jackie ^^
j
Could it be Kafka issue? Can you try consume it using some other Kafka consumer?
@Neha Pawar Any idea?
p
@Jackie: I am able to consume these messages elsewhere
j
These logs are from the Kafka consumer (not from the pinot code), and here is a ticket I found for the same issue in case it can help debug: https://issues.apache.org/jira/browse/KAFKA-10429