Hi guys, we're trying to setup <Flink DD Reporter>...
# troubleshooting
o
Hi guys, we're trying to setup Flink DD Reporter for Datadog. We managed to get it to work by adding the following config to FlinkDeployment:
Copy code
apiVersion: flink.apache.org/v1beta1
kind: FlinkDeployment   
.....
    metrics.reporter.prom.port: "9249"
    metrics.reporters: prom,dghttp
    metrics.scope.jm: flink.jobmanager
    metrics.scope.jm.job: flink.jobmanager.job
    metrics.scope.tm: flink.taskmanager
    metrics.scope.tm.job: flink.taskmanager.job
    metrics.scope.task: flink.task
    metrics.scope.operator: flink.operator
    metrics.reporter.dghttp.scope.variables.additional: flink_job_name:<flink_job_name>
    metrics.reporter.dghttp.factory.class: org.apache.flink.metrics.datadog.DatadogHttpReporterFactory
    metrics.reporter.dghttp.apikey: <api_key>
    metrics.reporter.dghttp.interval: 10 SECONDS
    metrics.reporter.dghttp.dataCenter: US
.....
However we had to hardcode the datadog api key into the FlinkDeployment yaml file for metrics.reporter.dghttp.apikey. We are using Flink Kubernete Operator helm chart to deploy Flink in our EKS cluster. Is there a way to inject secrets to FlinkDeployment jobs so we do not have to hardcode our Datadog API key in our VCS?
I found this which is related: https://github.com/apache/flink/pull/19684 Anytime we could merge this anytime soon?