You need to deploy the RBAC rules it is telling you are miss Fluent Community #fluent-operator

You need to deploy the RBAC rules it is telling yo...

Pat

10/16/2024, 8:29 AM

You need to deploy the RBAC rules it is telling you are missing, i.e. being able to list those CRDs on that SA. How and what are you installing? If you're doing things manually then you need to do all the things 🙂

Szern

10/16/2024, 8:41 AM

If I do the install of the operator without manually installing the CRDs then I get the error I mentioned earlier.

Pat

10/16/2024, 8:45 AM

but how, via helm/yaml? • https://github.com/fluent/fluent-operator?tab=readme-ov-file#deploy-fluent-operator-with-yaml • https://github.com/fluent/fluent-operator?tab=readme-ov-file#deploy-fluent-operator-with-helm Is it a fresh cluster? Previous CRDs?

Pat

10/16/2024, 8:49 AM

Ah, I see this on a fresh kind cluster with YAML install:

Copy code

➜  ~ kubectl apply -f <https://raw.githubusercontent.com/fluent/fluent-operator/release-3.2/manifests/setup/setup.yaml>

# You can change the namespace in manifests/setup/kustomization.yaml in corresponding release branch
# and then use command below to install to another namespace
# kubectl kustomize manifests/setup/ | kubectl apply -f -
<http://customresourcedefinition.apiextensions.k8s.io/clusterfilters.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/clusterfilters.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/clusterfilters.fluentd.fluent.io|customresourcedefinition.apiextensions.k8s.io/clusterfilters.fluentd.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/clusterfluentbitconfigs.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/clusterfluentbitconfigs.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/clusterfluentdconfigs.fluentd.fluent.io|customresourcedefinition.apiextensions.k8s.io/clusterfluentdconfigs.fluentd.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/clusterinputs.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/clusterinputs.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/clusterinputs.fluentd.fluent.io|customresourcedefinition.apiextensions.k8s.io/clusterinputs.fluentd.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/clustermultilineparsers.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/clustermultilineparsers.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/clusteroutputs.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/clusteroutputs.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/clusteroutputs.fluentd.fluent.io|customresourcedefinition.apiextensions.k8s.io/clusteroutputs.fluentd.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/clusterparsers.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/clusterparsers.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/collectors.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/collectors.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/filters.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/filters.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/filters.fluentd.fluent.io|customresourcedefinition.apiextensions.k8s.io/filters.fluentd.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/fluentbitconfigs.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/fluentbitconfigs.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/fluentbits.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/fluentbits.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/fluentdconfigs.fluentd.fluent.io|customresourcedefinition.apiextensions.k8s.io/fluentdconfigs.fluentd.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/inputs.fluentd.fluent.io|customresourcedefinition.apiextensions.k8s.io/inputs.fluentd.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/multilineparsers.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/multilineparsers.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/outputs.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/outputs.fluentbit.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/outputs.fluentd.fluent.io|customresourcedefinition.apiextensions.k8s.io/outputs.fluentd.fluent.io> created
<http://customresourcedefinition.apiextensions.k8s.io/parsers.fluentbit.fluent.io|customresourcedefinition.apiextensions.k8s.io/parsers.fluentbit.fluent.io> created
<http://clusterrole.rbac.authorization.k8s.io/fluent-operator|clusterrole.rbac.authorization.k8s.io/fluent-operator> created
<http://clusterrolebinding.rbac.authorization.k8s.io/fluent-operator|clusterrolebinding.rbac.authorization.k8s.io/fluent-operator> created
Error from server (Invalid): error when creating "<https://raw.githubusercontent.com/fluent/fluent-operator/release-3.2/manifests/setup/setup.yaml>": <http://CustomResourceDefinition.apiextensions.k8s.io|CustomResourceDefinition.apiextensions.k8s.io> "<http://fluentds.fluentd.fluent.io|fluentds.fluentd.fluent.io>" is invalid: metadata.annotations: Too long: must have at most 262144 bytes
Error from server (NotFound): error when creating "<https://raw.githubusercontent.com/fluent/fluent-operator/release-3.2/manifests/setup/setup.yaml>": namespaces "fluent" not found
Error from server (NotFound): error when creating "<https://raw.githubusercontent.com/fluent/fluent-operator/release-3.2/manifests/setup/setup.yaml>": namespaces "fluent" not found

I'm guessing kustomize is doing something to mess with the metadata

Pat

10/16/2024, 8:50 AM

Copy code

helm install fluent-operator --create-namespace -n fluent <https://github.com/fluent/fluent-operator/releases/download/v3.2.0/fluent-operator.tgz>

seems to work though

Szern

10/16/2024, 9:27 AM

Did the fluent bit pods come up? Do you have any errors in the operator container? I checked the logs and I get errors about missing CRD

Pat

10/16/2024, 10:08 AM

yup, all fine here

Pat

10/16/2024, 10:08 AM

again, did you use a fresh cluster or what?

Pat

10/16/2024, 10:11 AM

If you have a previous install then you must update the CRDs as well, that's not done by helm - there's a bit at the bottom of the install section for replacing CRDs: https://github.com/fluent/fluent-operator?tab=readme-ov-file#deploy-fluent-operator-with-helm

Szern

10/16/2024, 1:51 PM

@Pat Thanks for your time. I realized what happened. I had attempted to install the Fluent Operator from the charts in the github repository which I had cloned. That installation didn't work and thus when attempting to do the installation from the download release there was a clash with the CRDs which I hadn't removed prior to doing the installation. Everything is working now. Thanks again.

Pat

10/16/2024, 1:53 PM

No worries, glad you sorted it

Szern

10/16/2024, 2:00 PM

@Pat One last question. do you have recommendations for excellent documentation on using and configuring fluentbit with the operator?

Pat

10/16/2024, 2:01 PM

Nope, sorry I mainly use it without the operator

Szern

10/16/2024, 2:01 PM

thanks

Open in Slack

Previous Next