Hi guys, I'm using filesystem buffering to handle ...
# fluent-operator
a
Hi guys, I'm using filesystem buffering to handle the data and use es as ClusterOutput, the chunks are stored into filesystem. I want to control the size of the logical queue for an output plugin, this is done by
storage.total_limit_size
(here). but I found it didn't work when I added `totalLimitSize`in the ClusterOutput kind resource of fluent operator. I'm wondering if fluent operator has not support yet or I was missing something. thanks.
Copy code
apiVersion: fluentbit.fluent.io/v1alpha2
kind: ClusterOutput
metadata:
  name: logs-error
  labels:
    fluentbit.fluent.io/enabled: "true"
    fluentbit.fluent.io/component: logging
spec:
  match: from.kube.error
  es:
    totalLimitSize: "30M"
    host: "${elastic-log-endpoint}"
    port: 9200
    httpUser:
      valueFrom:
        secretKeyRef:
          key: elastic-username
          name: fluent-elastic-credentials
    httpPassword:
      valueFrom:
        secretKeyRef:
          key: elastic-password
          name: fluent-elastic-credentials
    # When enabled, generate _id for outgoing records. This prevents duplicate records when retrying ES
    generateID: true
    index: logs-error
    tls:
      verify: On