Hi Team , Zookeeper creating too many logs of pinot-broker which filling pvc too fast .Please sugeest how can we reduce it .

/pinot-shipment-qa/INSTANCES/Broker_shipment-qa-pinot-broker-0.shipment-qa-pinot-broker-headless.qa-team.svc.cluster.local_8099/HISTORY\00\00
r{
  "id" : "Broker_shipment-qa-pinot-broker-0.shipment-qa-pinot-broker-headless.qa-team.svc.cluster.local_8099",
  "simpleFields" : {
    "LAST_OFFLINE_TIME" : "-1"
  },
  "mapFields" : { },
  "listFields" : {
    "HISTORY" : [ "{DATE=2022-08-10T02:13:43:335, VERSION=0.9.8, SESSION=1000023e82c0005, TIME=1660097623335}", "{DATE=2022-08-10T05:31:44:779, VERSION=0.9.8, SESSION=300001510c30008, TIME=1660109504779}", "{DATE=2022-08-10T07:23:31:448, VERSION=0.9.8, SESSION=300001510c30009, TIME=1660116211448}", "{DATE=2022-08-10T10:12:09:434, VERSION=0.9.8, SESSION=1000023e82c000c, TIME=1660126329434}", "{DATE=2022-08-10T16:26:19:804, VERSION=0.9.8, SESSION=300000391830000, TIME=1660148779804}", "{DATE=2022-08-10T22:13:59:177, VERSION=0.9.8, SESSION=20000fe3c270001, TIME=1660169639177}",

You can set retention for zk logs?

What kind of logs? Transaction logs or application logs..

@Kishore G it seems like tranaction logs how can we check?

zk transaction logs are there in zk data and datalog dir. if those are filling up your disk, zk has a auto purge feature to purge the old transaction logs. you need to configure autopurge.snapRetainCount and autopurge.purgeInterval. More details at https://zookeeper.apache.org/doc/r3.4.5/zookeeperAdmin.html#sc_advancedConfiguration

Thanks @Laxman Ch one more thing Is zk produce application logs also , if yes how can we check