Hello, I’m using Flink(1.16) on Yarn in application mode. I’ve provided log4j.properties file under

conf

folder for Flink and I can see my

taskmanager.log

are giving output in expected format. However logs which are re-directed to

taskmanager.err

are missing

timestamp

field and not in expected format. e.g. one of taskmanager.err file(missing timestamp):

[main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 4
[main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 2
[main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: cluster.evenly-spread-out-slots, false
[main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: yarn.application.name, DCN-LogParser-Workflow
[main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: yarn.application.queue, default
[main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: $internal.application.main, ca.ix.dcn.job.JobRunner
[main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 8192m
[main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.prom.port, 9250-9260
[main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: execution.savepoint-restore-mode, NO_CLAIM
[main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: execution.savepoint.path, <hdfs://blackhole-auditlog/data/dcn-log-parser/checkpointing/073f246a185b81d373d218cd80abefd5/chk-762>

Here is the configuration for log4j file, that I’m using:

#Define root logger options
log4j.rootLogger=INFO, file, console

#Define console appender
log4j.appender.console=org.apache.log4j.ConsoleAppender
logrj.appender.console.Target=System.out
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss,SSS} %-5p %-60c %x - %m%n

#Define rolling file appender
log4j.appender.file=org.apache.log4j.RollingFileAppender
log4j.appender.file.File=${log.file}
log4j.appender.file.Append=true
log4j.appender.file.ImmediateFlush=true
log4j.appender.file.MaxFileSize=10MB
log4j.appender.file.MaxBackupIndex=5
log4j.appender.file.layout=org.apache.log4j.PatternLayout
log4j.appender.file.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss,SSS} %-5p %-60c %x - %m%n

What could be causing this ?