Hello everyone! I've been using Pinot for a few months. I noticed that my realtime table segments are stored on the same server when they should be balanced on all my servers by default. (that's what i'm looking for) I have four servers with the tag "*DefaultTenant_REALTIME*" and a table with 80 segments stored on my second server. Am I missing something important ?

you mean that all your segments are hosted in one sever instead of being evenly distributed among the 4?

How many partitions in your pulsar topic?

Yes, all my segments are hosted on the same server. The pulsar topic is not partitioned, I kept the default settings

That’s the reason

Thanks a lot, i'll check that But I don't understand why do i have to change this parameter ?

Because we distribute the number of partitions evenly among the servers

would you ideally recommend to have one server per partition (?)

if I understand correctly there can be only one server that consumes per partition and we can rebalance all the segments once they are all online We have tried this but the rebalance server action tells us that the segments are already balanced on Pinot

you need a special config to be able to move completed segments to other servers. By default, even the complted segments will stay on the same node as the CONSUMING one, for a given partition. We need this sticky routing for partition based routing, or upserts to work correctly. If you dont care about either of these, let me share that config.

ok I understand better now, i will add partitioning on Pulsar and I won't need rebalance server action after that thank you all for your answers

just in case: https://docs.pinot.apache.org/v/release-0.11.0/basics/getting-started/frequent-questions/operations-faq#why-does-my-realtime[…]-added-to-the-cluster