How are folks deploying zookeeper for their pinot ...
# troubleshootingp
Priyank Bagrecha
07/27/2022, 5:22 PMHow are folks deploying zookeeper for their pinot cluster in production? Are you using the helm charts as is? Or are you customizing it? Or are you using helm charts for deploying other components and using your own way for deploying zookeeper specifically?
d
Dan DC
07/27/2022, 5:44 PMWe deploy everything to kubernetes using our own custom charts for both pinot and zk and we deploy each component independently
Dan DC
07/27/2022, 5:45 PMAre you facing any issues?
p
Priyank Bagrecha
07/27/2022, 5:48 PMI am not facing any issue. I am just trying to learn from the community about best practices as we build our staging cluster, That way we can automate everything as we take it to production.
Priyank Bagrecha
07/27/2022, 5:52 PMI have only deployed zookeeper on bare metal instances before. This is my first time deploying an application over kubernetes and I want to make sure I don't miss anything specifically for zookeeper, and if it is enough to use helm charts as is, or if folks would recommend any other way.
d
Dan DC
07/27/2022, 6:46 PMIMO helm is probably the most flexible tool to deploy applications to kubernetes. I would advise taking a look at bitnami's zookeeper chart and deploy it separately. How much customisation you'll need I guess will depend on your pipelines, etc
Dan DC
07/27/2022, 6:48 PMYou'll need attachable storage for ZK and some of the pinot components so make sure you have a storage driver available in your kubernetes cluster
p
Priyank Bagrecha
07/27/2022, 6:59 PMThank you Dan! Is there any specific reason for using custom helm charts for deploying pinot components?
d
Dan DC
07/27/2022, 7:55 PMThe reasons are very specific to the processes we have in place. The chart provided with pinot is a good start and I believe would suite most deployments
p
Priyank Bagrecha
07/27/2022, 7:58 PMThat helps.
d
Dan DC
07/27/2022, 7:58 PMI would start from there and then only change it if doesn't meet all you needs
Dan DC
07/27/2022, 7:59 PMNo problem
p
Priyank Bagrecha
07/27/2022, 8:03 PMI am only worried about zookeeper honestly, mostly from my experiences managing it on bare metal instances.
d
Dan DC
07/27/2022, 8:08 PMI have deployed it in prod envs twice in the past and I haven't experienced major issues. If you have had previous experiences with bare metald and you have a good understanding of how kubernetes works, you should be good
👍 1