Apache Pinot

hey all, we continue to have issues with zookeeper on gke sadly, our sandbox environment got its space filled up does anyone know how to recover from this scenario, pretty much the entire system is sad at the moment

make sure that the you are purging the transaction logs and snapshot logs on Zookeeper machines

I don't know how to recover, but I had the same problem and fixed it by actually configuring a proper deep store with S3, so that my segments don't end up being all in local disks.

<https://support.datafabric.hpe.com/s/article/How-to-purge-Zookeeper-Transaction-Log-and-Snapshots?language=en_US>

we have deep storage retention for offline servers 2 years, retention for only 7 days

if you clean up the space and restart, everything should come back up

```clientPort=2181
dataDir=/data/snapshot
dataLogDir=/data/log
tickTime=2000
initLimit=10
syncLimit=10
maxClientCnxns=60
minSessionTimeout= 4000
maxSessionTimeout= 40000
autopurge.snapRetainCount=3
autopurge.purgeInterval=1
4lw.commands.whitelist=*
server.1=pinot-zookeeper-0.pinot-zookeeper-headless.pinot.svc.cluster.local:2888:3888
server.2=pinot-zookeeper-1.pinot-zookeeper-headless.pinot.svc.cluster.local:2888:3888
server.3=pinot-zookeeper-2.pinot-zookeeper-headless.pinot.svc.cluster.local:2888:3888```

```dataDir=/data/snapshot
dataLogDir=/data/log```


whats the size of this and is it filled up?