Hello Team, I am looking for airbyte monitoring. I want to use datadog for monitoring the job status and metrics. I am using OSS version installed on my system but I couldn't find the metrics api. Is it possible for OSS version to use metrics api integration with datadog? Any help if you can is appreciated. Thank you so much.

Yes, it is possible to use Datadog for monitoring with Airbyte Open Source (OSS) version. However, the metrics collection feature has become part of the [Airbyte Enterprise](https://airbyte.com/airbyte-enterprise) offer. This includes integration with Datadog and OpenTelemetry (OTEL) to collect metrics[^1^]. To set up the Datadog connector in Airbyte OSS, you can follow these steps[^2^]: 1. Navigate to the Airbyte Open Source dashboard. 2. Set the name for your source. 3. Enter your

api_key

- Datadog API key. 4. Enter your

application_key

- Datadog application key. 5. Enter your

query

- Optional. Type your query to filter records when collecting data from Logs and AuditLogs stream. 6. Enter your

limit

- Number of records to collect per request. 7. Enter your

start_date

- Optional. Start date to filter records when collecting data from Logs and AuditLogs stream. 8. Enter your

end_date

- Optional. End date to filter records when collecting data from Logs and AuditLogs stream. 9. Enter your

queries

- Optional. Multiple queries resulting in multiple streams. 1. Enter the

name

- Required. Query Name. 2. Select the

data_source

- Required. Supported data sources - metrics, cloud_cost, logs, rum. 3. Enter the

query

- Required. A classic query string. Example - "kubernetes_state.node.count{}"*, "@type:resource @resource.status_code:>=400 @resource.type:(xhr OR fetch)" 10. Click Set up source. You can also configure Airbyte to publish metrics collected by the Metrics Reporter. This can be done by setting the

PUBLISH_METRICS

to true. The

METRIC_CLIENT

can be set to

datadog

or `otel`[^3^]. For the list of metrics Airbyte OSS sends to Datadog, you can refer to this [link](https://github.com/airbytehq/airbyte-platform/blob/main/airbyte-metrics/metrics-lib/src/main/java/io/airbyte/metrics/lib/OssMetricsRegistry.java)[^4^]. [^1^]: [Collecting Metrics](https://docs.airbyte.com/operator-guides/collecting-metrics) [^2^]: [Set up the Datadog connector in Airbyte](https://docs.airbyte.com/integrations/sources/datadog) [^3^]: [Configuring Airbyte](https://docs.airbyte.com/operator-guides/configuring-airbyte) [^4^]: [OssMetricsRegistry.java](https://github.com/airbytehq/airbyte-platform/blob/main/airbyte-metrics/metrics-lib/src/main/java/io/airbyte/metrics/lib/OssMetricsRegistry.java)