https://pinot.apache.org/ logo
#general
Title
# general
j

Jinwei Zhu

01/04/2021, 7:25 PM
Hi team, I'm new to pinot and trying to get logs for troubleshooting using logz. I deployed pinot using k8s, want to make sure are the logs of different components exist in the according pods? like gc-pinot-broker.log and pinotBroker.log. What's the different? How to change the log levels? Is the log seen in kubectl logs same as seen inside the pod log file?
d

Daniel Lavoie

01/04/2021, 9:30 PM
Hi Jinwei, there’s indeed three different level of logs. *
gc-pinot-broker.log
will contain Garbage Collection statistics. Pinot being memory intensive, it is useful to get insights on history of garbage collection. *
pinotBroker.log
is configured with a
info
level on the root logger. *
kubectl logs
 will output the console appender which is configured on a
warn
level for the root logger.
As for overriding these configuration, it would involve mounting a congfigmap volume to the container and defining the
<component>.log4j2ConfFile
helm value.
If you are not using the helm chart, but creating the pod yourself, you can use the
JAVA_OPTS
to define the path to your customized log4j2.xml file with the
-Dlog4j2.configurationFile
JVM option.
j

Jinwei Zhu

01/04/2021, 10:04 PM
Hi Daniel, thanks for your reply! Yes, I have helm file and trying to put the logs to logz. So does it mean I need to mounting a congfigmap volume to the container and defining the 
<component>.log4j2ConfFile
 helm value? Do we have some examples about this? Thx
d

Daniel Lavoie

01/04/2021, 10:10 PM
What are you using to ship logs to logz?
j

Jinwei Zhu

01/14/2021, 7:26 PM
Is there any docs about the logs?