Hi guys, I am working my way thru the fluent-oper...
# fluent-operator
t
Hi guys, I am working my way thru the fluent-operator walkthru / fluentbit-only and I hit a wall with the opensearch ouput, it can not be loaded? Does any body have an idea what I did wrong?
Copy code
Fluent Bit v1.8.11
* Copyright (C) 2019-2021 The Fluent Bit Authors
* Copyright (C) 2015-2018 Treasure Data
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* <https://fluentbit.io>

Output plugin 'opensearch' cannot be loaded
[2024/03/09 08:55:38] [ info] [engine] started (pid=20)
[2024/03/09 08:55:38] [ info] [storage] version=1.1.5, initializing...
[2024/03/09 08:55:38] [ info] [storage] in-memory
[2024/03/09 08:55:38] [ info] [storage] normal synchronization mode, checksum disabled, max_chunks_up=128
[2024/03/09 08:55:38] [ info] [cmetrics] version=0.2.2
[2024/03/09 08:55:38] [ warn] [input:systemd:systemd.0] seek_cursor failed
[2024/03/09 08:55:38] [ info] [sp] stream processor started
my current config:
Copy code
---
apiVersion: fluentbit.fluent.io/v1alpha2
kind: ClusterOutput
metadata:
  name: opensearch
  labels:
    fluentbit.fluent.io/enabled: "true"
    fluentbit.fluent.io/mode: "fluentbit-only"
spec:
  matchRegex: (?:kube|service)\.(.*)
  opensearch:
    #bufferSize: 20MB
    host: logs.opensearch.svc.cluster.local
    port: 9200
    #scheme: https
    httpPassword:
      valueFrom:
        secretKeyRef:
          key: password
          name: opensearch
    httpUser:
      valueFrom:
        secretKeyRef:
          key: username
          name: opensearch
    #logstashPrefix: cluster01-
    #logstashFormat: true
    timeKey: "@timestamp"
    traceError: true
    tls:
      debug: 4
      verify: false
      #caFile: /fluent-bit/secrets/tcp-ssl/ca
      #crtFile: /fluent-bit/secrets/tcp-ssl/cert
      #keyFile: /fluent-bit/secrets/tcp-ssl/key
Copy code
[Service]
    Parsers_File    parsers.conf
[Input]
    Name    systemd
    Path    /var/log/journal
    DB    /fluent-bit/tail/kubelet.db
    DB.Sync    Normal
    Tag    service.kubelet
    Systemd_Filter    _SYSTEMD_UNIT=kubelet.service
[Filter]
    Name    lua
    Match    service.*
    script    /fluent-bit/config/systemd.lua
    call    add_time
    time_as_table    true
[Output]
    Name    opensearch
    Match_Regex    (?:kube|service)\.(.*)
    Host    logs.opensearch.svc.cluster.local
    Port    9200
    HTTP_User    xxx
    HTTP_Passwd    xxx
    Time_Key    @timestamp
    Trace_Error    true
    tls    On
    tls.verify    false
    tls.debug    4