Hi , How can I forward log to same file from all s...
# fluent-bit
j
Hi , How can I forward log to same file from all stages: startup, output. currently adding
log_file
in service just forwards startup logs but my output is kafka & not able to forward logs from it
mostly error logs from kafka. I am not seeing option from
rdkafka
p
Any logs reported by fluent bit should go there
j
seems like these are not forwarded to log file:
*[*2025/08/12 11:28:23*]* [error] [output:kafka:kafka.0] fluent-bit#producer-1:
I wish to capture some logs post startup , incase kafka publish fails
Copy code
outputs:

    - name: kafka
      match: '*'
      brokers: xxxxxx
      topics: topic
      rdkafka.security.protocol: 'SASL_SSL'
      rdkafka.sasl.mechanism: 'PLAIN'
      rdkafka.sasl.username: username
      rdkafka.sasl.password: password

      # Producer properties
      rdkafka.acks: '-1'
      rdkafka.retries: 2147483647
      rdkafka.max.in.flight.requests.per.connection: 1
      rdkafka.debug: 'All'
      rdkafka.enable.ssl.certificate.verification: false
logs from this output.
rdkafka
seems not have any log file option
p
Rdkafka is a library and based on the upstream code so if it exposes an option to do it you can use it. Those log messages should definitely be going though