if i increase the segment flush threshold time to ...
# troubleshootingp
Padma Malladi
08/31/2022, 9:46 PMif i increase the segment flush threshold time to 5 min, would that cause the zookeeper persitence storage to go up?
m
Mayank
08/31/2022, 9:55 PM
Yes that would be a reason. You probably want to limit retention to that so you keep only the last N snapshots.
p
Padma Malladi
08/31/2022, 9:59 PMThanks Mayank. when you say retention, which retention do you mean? not the retention of the data right?
Padma Malladi
08/31/2022, 10:05 PMor is it the same retentiontime specified by retentiontimeunit ?
m
Mayank
08/31/2022, 10:07 PM
No, this is not Pinot, but ZK. You need to set retention policy for ZK snapshot: https://zookeeper.apache.org/doc/r3.4.5/zookeeperAdmin.html
Mayank
08/31/2022, 10:07 PM
Also, as a side note, you probably want to run ZK separately from Pinot. The helm charts/docker image on the docs page are for QuickStart reference only, and necessarily for production env.
p
Padma Malladi
08/31/2022, 10:09 PMSure, Thanks