Hi we will be installing Pinot cluster in AWS on ...
# general
a
Hi we will be installing Pinot cluster in AWS on top of EKS. We know that in AWS EKS has Multi (Three) Availability Zone (AZ) based HA in a specific Region. So I would like to understand that whether the EKS based Pinot cluster will be by default Fault Tolerant & HA within the region in case of any AZ failure or not. I know that Pinot Server has Segment Replica and replica-group which provide HA within the cluster in case of server failure. But what will happen if the controller has issue in the cluster (on EKS) or multiple servers have been corrupted or the cluster (on EKS) as a whole goes down? Considering the fact that the server will have EBS as data serving file system (& EBS multi AZ replication/sync will be ON), will EKS by default bring up alternative node like Controller or Server (or even Broker)? Net-net can we expect 100% service availability in Pinot on EKS in any Region? Or do we need to setup another Pinot Cluster on EKS on another AZ i.e. minimum Two Pinot Cluster (On EKS) in Two AZ within a Region? Please suggest
k
Yes, Pinot is HA within a region.. as long as you make sure the replication factor is >1 and you have >1 controller and >1 broker
yes, K8s will bring up another server/controller/broker on failure and everything will be handled seamlessly
a
Thanks a lot
j
Are pinot segment replicas rack aware though by default?
k
No.. not by default. We have a concept of pools that can be used to achieve that. There is an effort to support rack awareness as a first class citizen
j
I see. Thanks! 🙂
h
what about the EBS volumes? Are the data replicated across EBS volumes?