Afif Mohd-Amir
04/03/2025, 4:16 PMRunLLM
04/03/2025, 4:16 PMShared subscription, messages are distributed among all consumers in a round-robin fashion, which should allow all 16 pods to consume messages. However, if you're using an Exclusive or Failover subscription, only one consumer (or a subset in the case of failover) will receive messages at a time.
Another possibility is that the receiver queue size or the consumer configuration might be limiting the number of messages each consumer can process at a time. According to Pulsar documentation, the receiver queue size determines how many messages a consumer can fetch at a time. If this is set too low, it might limit the throughput of each consumer.
Would you like more detailed guidance on how to configure your consumers or check the subscription type?
Sources:
- Pulsar documentation on message queues 👍 0 button 👎 1 button 💡 Hint: Mention @RunLLM in the thread for followups.