Robin Gong
06/04/2025, 3:58 AMtail below:
[INPUT]
Name tail
Tag test
Path /var/log/containers/test*_test*.log
Multiline.parser docker, cri, go
Docker_Mode true
Docker_Mode_Flush 4
Mem_Buf_Limit 30MB
Skip_Long_Lines true
Refresh_Interval 5
Buffer_Chunk_Size 320KB
Buffer_Max_Size 768KB
By this fluent-bit can only tail from the newly created logs while skipping the existing logs, as you can see I didn't set the Ignore_Old option.
I tried to add the Read_from_Head true and fluent-bit does grab the existing old logs, but here comes another issue when the fluent-bit config is updated or the fluent-bit pod is restarted, the log file will be tailed again from the beginning and leads to duplication.
Do you have any idea how to solve this?Pat
06/04/2025, 7:51 AMPat
06/04/2025, 7:52 AMPat
06/04/2025, 7:53 AMPat
06/04/2025, 8:03 AMPat
06/04/2025, 8:04 AMPat
06/04/2025, 8:05 AM