Apache Pinot

besides information about where servers/and configurations what else resides on zookeeper? I have seen the space of zookeeper incrementing in our cluster we have a 5gig persistent volume and i’m worried if may get filled up and how to increment space when that happens

I think the bigger storage space increase might be coming from logs/snapshots.

If so, you could purge the logs/snapshots and also set retention

Unless you have an ever increase number of segments (millions range)

we are on the order of thousands in terms of segments

and i don’t think it will ever get to millions given our retention policies

thank you for your pointer i iwll try to check the logs

please check zk config, you can set purge interval and how many snapshot you want to keep( typically 3)

hey <@UDQU92KBK> and <@UGRJA9TEH>, we grabbed whatever was there in the helm chart to config zookeeper

```env:
            - name: ZK_REPLICAS
              value: "3"
            - name: JMXAUTH
              value: "false"
            - name: JMXDISABLE
              value: "false"
            - name: JMXPORT
              value: "1099"
            - name: JMXSSL
              value: "false"
            - name: ZK_HEAP_SIZE
              value: "256M"
            - name: ZK_SYNC_LIMIT
              value: "10"
            - name: ZK_TICK_TIME
              value: "2000"
            - name: ZOO_AUTOPURGE_PURGEINTERVAL
              value: "0"
            - name: ZOO_AUTOPURGE_SNAPRETAINCOUNT
              value: "3"
            - name: ZOO_INIT_LIMIT
              value: "5"
            - name: ZOO_MAX_CLIENT_CNXNS
              value: "60"
            - name: ZOO_PORT
              value: "2181"
            - name: ZOO_STANDALONE_ENABLED
              value: "false"
            - name: ZOO_TICK_TIME
              value: "2000"```

def the logs are whatever are chugging that space

```64M	log.5000004f0
207M	log.700000001
918M	log.700002936
205M	log.b0000006f
1.8G	log.e00000001
253M	log.e000184b4```

```autopurge.purgeInterval : (No Java system property) New in 3.4.0: The time interval in hours for which the purge task has to be triggered. Set to a positive integer (1 and above) to enable the auto purging. Defaults to 0.```

and my auto purge interval is 0 so i guess it’s never kicking

then your disk usage will grow until full