Suhas Karanth
06/18/2025, 4:15 AMdefaultNamespaceBundleSplitAlgorithm to something other than the default?RunLLM
06/18/2025, 4:15 AMdefaultNamespaceBundleSplitAlgorithm to something other than the default (range_equally_divide) if your use case requires bundle splits based on topic count, specific hash positions, or message rate/throughput, rather than just evenly dividing the hash range. For example, use topic_count_equally_divide to balance the number of topics per bundle, specified_positions_divide for custom split points, or flow_or_qps_equally_divide to split based on message rate or throughput thresholds. This is useful for optimizing load distribution in clusters with uneven topic loads or specific performance requirements, as described in ServiceConfiguration.java and NamespaceBundleSplitAlgorithm.java.
Would you like more detail on when to use each algorithm?
Sources:
- ServiceConfiguration.java
- NamespaceBundleSplitAlgorithm.java 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.Suhas Karanth
06/18/2025, 4:16 AMRunLLM
06/18/2025, 4:17 AMSuhas Karanth
06/18/2025, 4:20 AMRunLLM
06/18/2025, 4:20 AMSuhas Karanth
06/18/2025, 4:46 AMloadBalancerNamespaceBundleMaxMsgRate ?RunLLM
06/18/2025, 4:46 AMSuhas Karanth
06/18/2025, 4:57 AMRunLLM
06/18/2025, 4:57 AMloadBalancerLoadSheddingStrategy in the broker.conf file. You can set it to strategies like ThresholdShedder, OverloadShedder, or UniformLoadShedder depending on your needs, as described in Pulsar Load Balance Docs and Broker Load Balancing Concepts.
Would you like more detail on each available strategy?
Sources:
- Pulsar Load Balance Docs
- Broker Load Balancing Concepts 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.Suhas Karanth
06/18/2025, 4:59 AMloadBalancerLoadSheddingStrategy to something other than the default?RunLLM
06/18/2025, 4:59 AMloadBalancerLoadSheddingStrategy to something other than the default (ThresholdShedder) if your cluster has specific load balancing needs, such as requiring immediate unloading when a broker exceeds a resource threshold (OverloadShedder), or if you want to distribute load uniformly by comparing the most and least loaded brokers (UniformLoadShedder). Each strategy is optimized for different scenarios, as detailed in Broker Load Balancing Concepts.
Would you like more detail on which strategy fits which scenario?
Sources:
- Broker Load Balancing Concepts 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.Suhas Karanth
06/18/2025, 5:26 AMdefaultNumberOfNamespaceBundles be dependent in any way on the number of broker nodes that will be present in the cluster?RunLLM
06/18/2025, 5:26 AMdefaultNumberOfNamespaceBundles should generally be set higher than the number of broker nodes in the cluster to ensure even distribution of load. For example, if you have 16 brokers, using 64 bundles achieves good distribution, as recommended in Pulsar Load Balance Docs.
Would you like more detail on how to choose the optimal number of bundles?
Sources:
- Pulsar Load Balance Docs 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.