Hi, I am going to setup apache-pinot for production on AWS EKS and I want to setup multi AZ setup So how would I manage the data because ebs volume support only in single AZ. Can we use efs ? Please suggest Setup should be scaleable and fault tolerance Thanks

I recommend that a single pinot cluster does not span across AZ, You can replicate the cluster in different AZ by replicating the data pipelines, for DR.

Thanks @User, Is there any document which guide me to setup multi AZ data replication

I think he meant replication in a single zone, like on multiple nodes. For multiple zones though you could manually structure your data ingestion to be done at all the desired zones. For example publishing events to multiple Kafka instances.

Yes, that’s what I meant. For streaming, something like mirror maker will replicate Kafka. For offline ingestion, the same pipeline can push data to multiple Pinot clusters in different AZs