Hey everyone, We are running Pinot 1.4 on Kubernetes. Currently, we store log files on EBS under the path

logs/pinotBroker

. Since this is ephemeral storage, the log files are lost whenever the pod restarts. We use custom Log4j configurations. Pinot is quite chatty, so we only send error logs to stdout in a structured format and ship them to Elasticsearch via Fluent Bit. Now we also want to persist: • component log files • query logs • audit logs Mainly so we can debug incidents later. Would it work if we simply changed

LOG_DIR

to point to an S3 path? • How would Pinot handle rolling log files in that case? • Would old files be deleted automatically? If S3 is not a good option, we can instead use a persistent EBS volume. • In that setup, does Pinot automatically clean up old log files periodically to avoid the volume filling up? Thanks!

You can use ebs. And you can configure log4j to set retention and rolling logs