Hi All , Currently I am working in Pinot POC to s...
# general
n
Hi All , Currently I am working in Pinot POC to solve OLAP based needs in our org.Our architect team worried about using zookeeper/helix as metadata storage . Lets say , if want to run Pinot for 5 year in production, at certain point of time ,zookeeper will run into disk space full issue as it store all segments metadata in it. right ? . [Druid is using sql database (mysql/postgresdb) to store this kind of metadata] Please suggest right solution to solve this problem. also curious to know about how other big giant (Uber ,Linkedin , etc ) using pinot in their production setup.
k
Helix/zookeeper has been used in production for 10+ years. managing thousands of nodes. what Pinot stores in ZK is minimal and has never been an issue.
👍 1
m
Yes, this is true for multiple orgs across different companies ^^ @User
👍 1