@kapa.ai, what are dataplane credentials used for in airbyte

In Airbyte, data plane credentials are used to authenticate and identify a data plane with the control plane. Specifically, the credentials consist of a Client ID and a Client Secret, which are stored as Kubernetes secrets and referenced in the data plane's Helm chart configuration. They allow the data plane to securely communicate with and register itself to the Airbyte control plane. [Kubernetes Secrets config] For example, in the

values.yaml

file, these credentials are referenced like this:

dataPlane:
  secretName: airbyte-config-secrets
  id: "preview-data-plane"

  clientIdSecretName: airbyte-config-secrets
  clientIdSecretKey: DATA_PLANE_CLIENT_ID
  clientSecretSecretName: airbyte-config-secrets
  clientSecretSecretKey: DATA_PLANE_CLIENT_SECRET

And the corresponding Kubernetes secret stores the actual credential values:

apiVersion: v1
kind: Secret
metadata:
  name: airbyte-config-secrets
type: Opaque
stringData:
  DATA_PLANE_CLIENT_ID: your-data-plane-client-id
  DATA_PLANE_CLIENT_SECRET: your-data-plane-client-secret

[Enterprise Flex data plane] In summary, data plane credentials serve as the authentication mechanism that allows a deployed data plane to identify itself to the Airbyte control plane, enabling the control plane to route sync workloads to the correct data plane. [Multi-region deployment] 👍 0 button 👎 0 button ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.