Daniel Wunderlich
04/28/2025, 2:19 PMjute.maxbuffer. So it's about time we reviewed and upgraded our setup, including setting up a merge rollup task to solve the small segments situation.
Main plan:
• Upgrade Pinot to the latest version
â—¦ Is it best to start a fresh cluster/helm installation and restore segments from S3, or can we just upgrade Helm? Are segments backwards-compatible?
• Use 2+ replicas for each component, and at least 2 K8S nodes for HA.
â—¦ Any recommendations on instance types? I hear that M/T are generally good.
â—¦ I read somewhere that it's best to run Zookeeper on its own, and not use the "embedded" Helm chart. Is this correct?
Any other suggestions/pitfalls? Really appreciate the help.Xiang Fu
Xiang Fu
Xiang Fu
Daniel Wunderlich
04/30/2025, 9:33 AM