Hi <@UDQU92KBK> Is it possible pinot single table ...
# troubleshooting
m
Hi @Mayank Is it possible pinot single table can consume from two different region, we can pass 2 urls or 2 brokers?
We are doing this for disaster recovery
@Mayank I see a concept of Multi-stream ingestion in pinot in 1.3.0
m
Yes that is possible. But for DR, you probably want to have one deployment per region.
Cross region ingestion will have data transfer cost associated with it
m
Did not understand the second point you mentioned
m
Cloud providers may charge you cost of cross region data transfer
m
okay why we thought to ingest two region data in one pinot cluster for a specific table so that all data stays together and we will have 2 cluster for pinot and both would be listening to scus and wus in each of table configs so the data stays same in both cluster
Something like this.
m
I have seen folks use mirror maker for replicating Kafka and then use that to ingest into Pinot
m
@Mayank How to do a DR for pinot db only
What if pinot cluster is down