Allan Jarina
11/06/2025, 12:11 AMPoorna Premachandra
11/06/2025, 4:43 AMAviad Deri
11/06/2025, 6:56 AMsecretName where password is stored
passwordSecretKey: "database-password" # e.g."database-password"
temporal:
extraEnv:
- name: SKIP_DB_CREATE
value: "true"
- name: DBNAME
value: temporal_qa
- name: VISIBILITY_DBNAME
value: temporal_visibility_qa
- name: POSTGRES_TLS_ENABLED
value: "false"
- name: SQL_TLS_ENABLED
value: "false"
but getting the error:
Starting Helm Chart installation of 'airbyte/airbyte' (version: 1.6.4)
ERROR Failed to install airbyte/airbyte Helm Chart
ERROR Unable to install Airbyte locally
ERROR unable to install airbyte chart: unable to install helm: cannot patch "airbyte-abctl-connector-builder-server" with kind Deployment: Deployment.apps "airbyte-abctl-connector-builder-server" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app.kubernetes.io/instance":"airbyte-abctl", "app.kubernetes.io/name":"connector-builder-server"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable && cannot patch "airbyte-abctl-cron" with kind Deployment: Deployment.apps "airbyte-abctl-cron" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app.kubernetes.io/instance":"airbyte-abctl", "app.kubernetes.io/name":"cron"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable && cannot patch "airbyte-abctl-server" with kind Deployment: Deployment.apps "airbyte-abctl-server" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app.kubernetes.io/instance":"airbyte-abctl", "app.kubernetes.io/name":"server"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable && failed to create patch: The order in patch list:
[map[name:AUTO_SETUP value:true] map[name:DB value:postgres12] map[name:DYNAMIC_CONFIG_FILE_PATH value:config/dynamicconfig/development.yaml] map[name:POSTGRES_TLS_ENABLED value:false] map[name:POSTGRES_TLS_ENABLED value:true] map[name:POSTGRES_TLS_DISABLE_HOST_VERIFICATION value:true] map[name:SQL_TLS_ENABLED value:true] map[name:SQL_TLS_DISABLE_HOST_VERIFICATION value:true]]
doesn't match $setElementOrder list:
[map[name:AUTO_SETUP] map[name:DB] map[name:DYNAMIC_CONFIG_FILE_PATH] map[name:POSTGRES_SEEDS] map[name:DB_PORT] map[name:POSTGRES_USER] map[name:POSTGRES_PWD] map[name:POSTGRES_TLS_ENABLED] map[name:POSTGRES_TLS_DISABLE_HOST_VERIFICATION] map[name:SQL_TLS_ENABLED] map[name:SQL_TLS_DISABLE_HOST_VERIFICATION] map[name:SKIP_DB_CREATE] map[name:DBNAME] map[name:VISIBILITY_DBNAME] map[name:POSTGRES_TLS_ENABLED] map[name:SQL_TLS_ENABLED] map[name:AIRBYTE_INSTALLATION_ID]]
&& cannot patch "airbyte-abctl-worker" with kind Deployment: Deployment.apps "airbyte-abctl-worker" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app.kubernetes.io/instance":"airbyte-abctl", "app.kubernetes.io/name":"worker"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable && cannot patch "airbyte-abctl-workload-api-server" with kind Deployment: Deployment.apps "airbyte-abctl-workload-api-server" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app.kubernetes.io/instance":"airbyte-abctl", "app.kubernetes.io/name":"workload-api-server"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable && cannot patch "airbyte-abctl-workload-launcher" with kind Deployment: Deployment.apps "airbyte-abctl-workload-launcher" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app.kubernetes.io/instance":"airbyte-abctl", "app.kubernetes.io/name":"workload-launcher"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutableSean Stach
11/06/2025, 8:31 AMChristian Malan
11/06/2025, 9:39 AMRenu Fulmali
11/06/2025, 9:43 AMGaurav Jain
11/06/2025, 11:17 AMNeeraj N
11/06/2025, 11:41 AMKothapalli Venkata Avinash
11/06/2025, 11:42 AMIlan Gresserman
11/06/2025, 1:23 PMlicenseKeySecretName where the Airbyte license key is stored
licenseKeySecretKey: ""
# -- The URL where Airbyte will be reached; This should match your Ingress host
airbyteUrl: ""
# Docker image config that will apply to all images.
image:
# Docker registry to pull platform images from, e.g. http://my-registry:8000/
registry: ""
# Image tag to use for airbyte images.
# Does not include non-airbyte images such as temporal, minio, etc.
tag: ""
# Docker image pull secret
imagePullSecrets: []
# -- Auth configuration
auth:
# -- Whether auth is enabled
enabled: false
# -- Admin user configuration
instanceAdmin:
# -- The first name of the initial user
firstName: ""
# -- The last name of the initial user
lastName: ""
# -- The key within emailSecretName where the initial user's email is stored
emailSecretKey: ""
# -- The key within passwordSecretName where the initial user's password is stored
passwordSecretKey: ""
# -- SSO Identify Provider configuration; (requires Enterprise)
identityProvider:
# -- Secret name where the OIDC configuration is stored
secretName: ""
# -- The identity provider type (e.g. oidc)
type: "" # one of: "oidc" or "generic-oidc"
# -- OIDC configuration (required if auth.identityProvider.type is "oidc")
#oidc:
# # -- OIDC application domain
# domain: ""
# # -- OIDC application name
# appName: ""
# # -- OIDC application display name
# displayName: ""
# # -- The key within clientIdSecretName where the OIDC client id is stored
# clientIdSecretKey: ""
# # -- The key within clientSecretSecretName where the OIDC client secret is stored
# clientSecretSecretKey: ""
# -- Generic OIDC configuration (required if auth.identityProvider.type is "generic-oidc")
#genericOidc:
# clientId: ""
# audience: ""
# issuer: ""
# extraScopes: ""
# endpoints:
# authorizationServerEndpoint: ""
# jwksEndpoint: ""
# fields:
# subject: sub
# email: email
# name: name
# issuer: iss
internalApi: {}
# -- Security configuration
security:
secretName: ""
cookieSecureSetting: true
cookieSameSiteSetting: Strict
jwtSignatureSecretKey: ""
dataPlane:
clientIdSecretKey: ""
clientSecretSecretKey: ""
api: {}
aws:
assumeRole:
accessKeyId: ""
accessKeyIdSecretKey: ""
secretAcessKey: ""
secretAccessKeySecretKey: ""
# -- Environment variables
env_vars: {}
# -- Secrets
secrets: {}
# -- CloudSQLProxy configuration
cloudSqlProxy:
enabled: false
# -- Database configuration
database:
type: internal # "external"
# -- Secret name where database credentials are stored
# -- The database host
host: ""
# -- The database port
port:
# -- The database name
name: "airbyte"
# -- The database user
user: "airbyte"
# -- The key within secretName where the user is stored
#userSecretKey: "" # e.g. "database-user"
# -- The database password
password: "Nagomi12345"
# -- The key within secretName where the password is stored
#passwordSecretKey: "" # e.g."database-password"
dataplaneGroups: {}
migrations:
runAtStartup: true
configDb:
minimumFlywayMigrationVersion: ""
jobsDb:
minimumFlywayMigrationVersion: ""
storage:
secretName: ""
# -- The storage backend type. Supports s3, gcs, azure, minio (default)
type: gcs # default storage used
# Minio
# minio:
# accessKeyId: minio
# secretAccessKey: minio123
bucket:
log: airbyte-audit-and-logging
auditLogging: airbyte-audit-and-logging
state: airbyte-audit-and-logging
workloadOutput: airbyte-audit-and-logging
activityPayload: airbyte-audit-and-logging
# S3
# s3:
# region: "us-east-2"
# authenticationType: instanceProfile
# S3
#s3:
# region: "" ## e.g. us-east-1
# authenticationType: credentials ## Use "credentials" or "instanceProfile"
# accessKeyId: ""
# secretAccessKey: ""
# GCS
gcs:
projectId: panda-poc-451212
credentialsJson: ewogICJ0eXBlIjogInNlcnZpY2VfYWNjb3VudCIsCiAgInByb2plY3RfaWQiOiAicGFuZGEtcG9jLTQ1MTIxMiIsCiAgInByaXZhdGVfa2V5X2lkIjogIjRiNTA5NDg4ODlhNjAzMDUyZDgzOGU2Y2E0MDc4N2ZkZWNhYjU2MWQiLAogICJwcml2YXRlX2tleS.....
credentialsJsonPath: /secrets/gcs-log-creds
# Azure
#azure:
# # one of the following: connectionString, connectionStringSecretKey
# connectionString: <azure storage connection string>
# connectionStringSecretKey: <secret coordinate containing an existing connection-string secret>
#awsSecretManager:
# region: <aws-region>
# authenticationType: credentials ## Use "credentials" or "instanceProfile"
# tags: ## Optional - You may add tags to new secrets created by Airbyte.
# - key: ## e.g. team
# value: ## e.g. deployments
# - key: business-unit
# value: engineering
# kms: ## Optional - ARN for KMS Decryption.
googleSecretManager:
projectId: panda-poc-451212
region: "us-central1" ## e.g.§ us-central1
credentialsSecretKey: gcp.json
#azureKeyVault:
# tenantId: ""
# vaultUrl: ""
# clientId: ""
# clientIdSecretKey: ""
# clientSecret: ""
# clientSecretSecretKey: ""
# tags: ""
#vault:
# address: ""
# prefix: ""
# authToken: ""
# authTokenSecretKey: ""
logging:
level: info
httpAccessLogsEnabled: false
log4jConfigFile: "/opt/airbyte/log4j2-json.xml"
connectorRegistry:
seedProvider: remote
connectorRollout:
expirationSeconds:
waitBetweenRolloutSeconds:
waitBetweenSyncResultsQueriesSeconds:
workloads:
secretName: ""
namespace: jobs
images:
workloadInit: ""
connectorSideCar: ""
containerOrchestrator: ""
containerOrchestrator:
secretName: "airbyte-config-secrets"
secretMountPath: "/secrets/gcs-log-creds/gcp.json"
dataPlane:
secretName: ""
secretMountPath: ""
queues:
check: [CHECK_CONNECTION]
discover: [DISCOVER_SCHEMA]
sync: [SYNC]
pubSub:
enabled: false
topicName: ""
resources:
useConnectorResourceDefaults: true
mainContainer:
cpu: {}
memory: {}
check:
cpu: {}
memory: {}
discover:
cpu: {}
memory: {}
replication:
cpu: {}
memory: {}
sidecar:
cpu: {}
memory: {}
fileTransfer:
storage:
request: 5G
limit: 5G
featureFlags:
secretName: ""
client: configfile
configfile: {}
#launchdarkly:
# key: ""
java:
opts: []
metrics:
enabled: false
step: ""
otlp:
enabled: false
# -- The open-telemetry-collector endpoint that metrics will be sent to
collectorEndpoint: ""
statsd:
enabled: false
flavor: ""
host: ""
port: ""
otel:
resourceAttributes: {}
collector:
endpoint: ""
exporter:
name: otlp
protocol: grpc
timeout: 30000
metricExportInterval: 10000
# Jobs resource requests and limits, see http://kubernetes.io/docs/user-guide/compute-resources/
# We usually recommend not to specify default resources and to leave this as a conscious
# choice for the user. This also increases chances charts run on environments with little
# resources, such as Minikube.
jobs:
resources:
## Example:
## requests:
## memory: 256Mi
## cpu: 250m
# -- Job resource requests
requests: {}
## Example:
## limits:
## cpu: 200m
## memory: 1Gi
# -- Job resource limits
limits: {}
kube:
_## JOB_KUBE_ANNOTATIONS_
# pod annotations of the sync job and the default pod annotations fallback for others jobs
# -- key/value annotations applied to kube jobs
annotations: {}
_## JOB_KUBE_LABELS_
## pod labels of the sync job and the default pod labels fallback for others jobs
# -- key/value labels applied to kube jobs
labels: {}
_## JOB_KUBE_NODE_SELECTORS_
## pod node selector of the sync job and the default pod node selector fallback for others jobs
# -- Node labels for pod assignment
nodeSelector: {}
_## JOB_KUBE_TOLERATIONS_
# -- Node tolerations for pod assignment
# Any boolean values should be quoted to ensure the value is passed through as a string.
_## JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET_
# -- image pull secret to use for job pod
mainContainerImagePullSecret: ""
_## JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY_
# -- image pull policy to use for job pod
mainContainerImagePullPolicy: ""
localVolume:
enabled: false
scheduling:
check:
nodeSelectors: {}
runtimeClassName: ""
discover:
nodeSelectors: {}
runtimeClassName: ""
isolated:
nodeSelectors: {}
runtimeClassName: ""
sourceDeclarativeManifest:
nodeSelectors: {}
runtimeClassName: ""
errors:
reportingStrategy: logging
#sentry:
# dsn: ""
topology:
nodeSelectorLabel: airbyte/node-pool
nodeSelectors:
mainNodePool: main
jobsNodePool: jobs
quickJobsNodePool: quick-jobs
temporal:
secretName: ""
cli:
address: ""
namespace: ""
tlsCert: ""
tlsCertSecretKey: TEMPORAL_CLOUD_CLIENT_CERT
tlsKey: ""
tlsKeySecretKey: TEMPORAL_CLOUD_CLIENT_KEY
cloud:
enabled: false
host: ""
namespace: ""
clientCert: ""
clientCertSecretKey: TEMPORAL_CLOUD_CLIENT_CERT
clientKey: ""
clientKeySecretKey: TEMPORAL_CLOUD_CLIENT_KEY
sdk:
rpc:
timeout: 120s
longPollTimeout: 140s
queryTimeout: 20s
stigg:
secretName: ""
apiKeySecretKey: ""
datadog:
enabled: false
env: dev
traceAgentPort: 8126
statsd:
port: 8125
integrations:
dbm:
enabled: false
propagationMode: full
grpc:
enabled: false
clientEnabled: false
serverEnabled: false
googleHttpClient:
enabled: false
httpUrlConnection:
enabled: false
kotlinCoroutineExperimental:
enabled: false
urlConnection:
enabled: false
netty:
enabled: false
netty41:
enabled: false
customerio:
secretName: ""
apiKeySecretKey: ""
tracking:
enabled: true
secretName: ""
strategy: segment # one of: logging, segment
segment:
writeKey: ""
writeKeySecretKey: ""
micronaut:
environments: ["k8s"]
extraSelectorLabels: {}
extraInitContainers: []
extraContainers: []Rahul
11/06/2025, 1:26 PMZawar Khan
11/06/2025, 3:00 PMtimeout variable in the request? If we create a stream in our manifest.ymlAltan Sener
11/06/2025, 3:25 PMMichael Sonnleitner
11/06/2025, 5:01 PMIlya Semenov
11/06/2025, 5:02 PMClément Lombard
11/06/2025, 5:07 PMKaique G. Viana
11/06/2025, 5:44 PMDaniel Adler
11/06/2025, 7:08 PMAlex Danilin
11/07/2025, 9:43 AM{"changes":[{"change":"NULLED","field":"domain","reason":"DESTINATION_SERIALIZATION_ERROR"}],"sync_id":31050}
I the sync logs, I see the following:
2025-11-06 16:42:31 platform WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2025-11-06 16:42:57 platform WARN main c.k.j.j.JsonSchemaGenerator$MyJsonFormatVisitorWrapper(expectAnyFormat):725 Not able to generate jsonSchema-info for type: [simple type, class com.fasterxml.jackson.databind.JsonNode] - probably using custom serializer which does not override acceptJsonFormatVisitor
2025-11-06 16:43:26 destination ERROR SLF4J(W): Class path contains multiple SLF4J providers.
2025-11-06 16:43:26 destination ERROR SLF4J(W): Found provider [org.apache.logging.slf4j.SLF4JServiceProvider@2de8284b]
2025-11-06 16:43:26 destination ERROR SLF4J(W): Found provider [org.slf4j.reload4j.Reload4jServiceProvider@396e2f39]
2025-11-06 16:43:26 destination ERROR SLF4J(W): See <https://www.slf4j.org/codes.html#multiple_bindings> for an explanation.
2025-11-06 16:43:26 destination ERROR SLF4J(I): Actual provider is of type [org.apache.logging.slf4j.SLF4JServiceProvider@2de8284b]
2025-11-06 16:43:26 source WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2025-11-06 16:43:28 destination WARN main c.k.j.j.JsonSchemaGenerator$MyJsonFormatVisitorWrapper(expectAnyFormat):725 Not able to generate jsonSchema-info for type: [simple type, class com.fasterxml.jackson.databind.JsonNode] - probably using custom serializer which does not override acceptJsonFormatVisitor
How can I check what the reason is for DESTINATION_SERIALIZATION_ERROR result in BigQuery?Sachin Bedraman
11/07/2025, 9:49 AMGaurav Jain
11/07/2025, 10:21 AMSteven Ayers
11/07/2025, 10:58 AMAgi Nyulfalvi
11/07/2025, 11:01 AMRahul
11/07/2025, 11:08 AMSteven Ayers
11/07/2025, 11:09 AMSteven Ayers
11/07/2025, 11:49 AMSlackbot
11/07/2025, 1:43 PMSlackbot
11/07/2025, 3:02 PMArsénio Costa
11/07/2025, 3:53 PMKaique G. Viana
11/07/2025, 6:37 PM