Hi and Happy Friday to y'all! I have a question about Pinot and Zookeeper. We already have a Zookeeper (and Kafka) deployed in production. Do we need a second Zookeeper to handle Pinot separately or can we point Pinot to the existing one? Perhaps the answer is obvious, since the name Zookeeper would imply having more than one animal to attend to! 😄

I have deployed pinot on kubernetes and it is definitely possible and infact recommended to have a separate production ready zookeeper deployment. You just need to disable the default zookeeper in helm chart here and provide your zookeeper url here If you are not using kubernetes, I am sure you can find a way to plug in your own zookeeper instance in a similar way. I am also a beginner so maybe someone experienced could add more details on this topic.

You should be able to point to the same zookeeper for pinot. you just need to provide it a directory under which pinot will create the cluster, and its metadata, etc. The write-qps on zk is roughly proportional to the number of segments you create/delete in pinot tables (times number of replicas you have, of course). You can decide if the same zk can handle that write qps.

Thank you both of you for your answers! I'll look into it.

@Julius Norinder it will be great if you can let us (and the community) know what worked. Thanks

Will do! 👍