I have a zookeeper quorum on ec2 instances. Just wanted to check if i can provide the zookeeper quorum addresses as a comma seperated values for controller.zk.str and similar params for broker and server? Just wanted to try this out on EC2 instances instead of EKS.

if eks nodes can resolve the dns then it’s possible, you can quickly check it by enter into a k8s container

I am not using eks since I dont have much experience in K8s. I am having multiple ec2 instances for each of the components (servers, brokers and coordinators). Just wanted to know if i can pass the ZK quorum addresses as a param when I start the other components @Xiang Fu

then it’s totally fine

Might sound trivial, but the broker and server configs doesn’t have a parameter for passing zookeeper info like the controller? But I can see in the documentation that we can pass zkAddress as a CLI argument. https://docs.pinot.apache.org/configuration-reference/broker https://docs.pinot.apache.org/configuration-reference/server

You can use the same config as for the controller (

controller.zk.str

) or you could use

pinot.zk.server

Oh okay. Was expecting something similar but got confused since it wasnt listed on the docs. Let me try it that way. Thanks

no auto rebalance, you need to call controller api to rebalance the table explicitly

@Xiang Fu even in the case of kinesis data stream(on demand) ingestion?

yes

There is a different thread which has a different answer.

but not moving old data to that server

Oh okay. So the new data will move into the new server without rebalancing but for old data to move into new server requires rebalancing?

rebalance is for redistribute old data

Got it.