@kapa.ai we have a self hosted Airbyte. Can we setup connection state to be stored in a database?

failed to determine if any previous psql version exists: error reading pgdata version file: open /home/glpd/.ai

This message was deleted.

This message was deleted.

@kapa.ai Is it possible to set up a connection to a Databricks lakehouse as a source in Airbyte Cloud? Can I do something like use a JDBC connector to replicate a SQL table as I would with a Postgres or MSSQL database?

@kapa.ai, We have a MySql->Snowflake connection taking daily full-refresh/append snapshots with final tables disabled. We want to reconfigure it to Snowflake direct-load, unfortunately we do have some deprecated but still running processes using the raw tables. I know I can update the existing connection to direct-load with legacy raw tables and that will keep the raw tables updated without breaking the processes. Raw tables compatibility support says I should create a new connection that direct-loads to the final tables. If I do that, how can I migrate the current raw history to the new connection?

@kapa.ai, if I stop an EC2 on which I have airbyte installed with abctl, then start the instance again will it start automatically or I should do some config for this ?

@kapa.ai Is there a way to use Record Selector but keep the parent attributes?

@kapa.ai ga4 backoff isnt long enough, keeps hitting api limits and then times out the job and does 2nd attempt, starting over

@kapa.ai In version 1.8.5 running on k8s, how do I configure platform concurrency so not more than N concurrent syncs happen?

@kapa.ai how to extract string array like this:

any thing worng? NAME READY STATUS RESTARTS AGE airbyte-abctl-bootloader 0/1 Completed 0 26d airbyte-abctl-cron-b6df94fbb-5bdnt 1/1 Running 4 (2m ago) 26d airbyte-abctl-manifest-server-5857bb75f9-xwttl 1/1 Running 4 (2m ago) 26d airbyte-abctl-server-ddf787dcc-v2mn5 1/1 Running 4 (2m ago) 26d airbyte-abctl-temporal-5c67b77849-tf798 1/1 Running 4 (2m ago) 26d airbyte-abctl-worker-7945b979d6-27cq6 1/1 Running 4 (2m ago) 26d airbyte-abctl-workload-api-server-579b6c4fd8-2x426 1/1 Running 4 (2m ago) 26d airbyte-abctl-workload-launcher-68b4ddf95b-dcks6 1/1 Running 8 (81s ago) 26d airbyte-db-0 1/1 Running 4 (2m ago) 26d

INFO Using Kubernetes provider: Provider: kind Kubeconfig: /home/glpd/.airbyte/abctl/abctl.kubeconfig Context: kind-airbyte-abctl SUCCESS Found Docker installation: version 28.3.3 SUCCESS Existing cluster 'airbyte-abctl' found INFO Found helm chart 'airbyte-abctl' Status: deployed Chart Version: 2.2.0 App Version: 2.2.0 INFO Found helm chart 'ingress-nginx' Status: deployed Chart Version: 4.15.1 App Version: 1.15.1 INFO Airbyte should be accessible via localhost

@kapa.ai airbyte 1.8.5 postgres destination does

select count(*)

from the table it just loaded. Can that be configured off?

@kapa.ai, i am replicating data from postgres to s3 in cdc manner but when i record gets deleted in the source in destination the deleted_at column for that record doesn't get updated and its still null

@kapa.ai Since upgrading to v2.2 we are receiving below error on deploying terraform sources and destinations. What permissions are missing? Deployment is EKS based with Terraform provider version 1.3 │ unknown status code returned: Status 500 │ {"status":500,"type":"reference.airbyte.com/reference/errors","title":"unexpected-problem","detail":"An unexpected problem has occurred. If this is │ an error that needs to be addressed, please submit a pull request or github issue.","documentationUrl":null,"data":{"message":"Failed to read secret │ airbyte_workspace_2fc21f58-9ce6-448e-a465-6807de524c49_secret_a30d113c-5f0e-47a9-a857-ddd569e71513_v10: The security token included in the request is │ invalid."}}

@kapa.ai any plans on this being fixed? github.com/airbytehq/airbyte/issues/48851

@kapa.ai I want to have a airbyte syncs from mongo to azure data blob storage, but I want to change the destination mid run, so see I want after a full refresh, I want the new files to go to a different folder instead of the old. folder, this is all to avoid having the history data in a folder

@kapa.ai I'm using Airbyte Cloud. Is it possible to set up an S3 bucket as a source and authenticate using an IAM role with the AWS role ARN?

@kapa.ai Migrating Postgres CDC connections between two self-hosted Airbyte instances (both Community 2.0.0). Same source Postgres server, same slot names, same publications. Instance B's connections are built but inactive; Instance A is still consuming the slots. If I disable a connection on A and enable its equivalent on B without transplanting any state, what does B do on its first sync — resume from the slot's restart_lsn, or treat the connection as new and re-snapshot? That's the one I most need to be sure about. Related: 1. Is a slot reusable across instances at all, given only one consumer attaches at a time? Or does Airbyte tie a slot to the instance that created it? 2. If B resumes from restart_lsn, does the CDC state/offset need to move from A to B, or is the slot sufficient on its own? 3. Is there a supported way to move CDC state between instances? The failure mode I'm trying to avoid is both instances advancing the same LSN at different times, each silently consuming changes the other never sees — nothing errors, rows just go missing.

@kapa.ai please provide sample terraform resources for creating a airtable source

Hi @kapa.ai, I'm trying to import new fields from a mongodb database. The problem is that airbyte is not updating the schema even after several rounds of "Refresh Source Schema", so I can't import those new fields. I have tried to re-create the source/connection from scratch as well as increasing the document discovery size to 20000, but no luck so far. Has there been any previous incident similar to the issue I'm facing?

@kapa.ai when I am creating the appleads connector, am getting this below error 'Encountered an error while checking availability of stream campaigns. Error: 400 Client Error: Bad Request for url: appleid.apple.com/auth/oauth2/token?grant_type=client_credentials&scope=searchadsorg' ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/airbyte_cdk/sources/streams/http/requests_native_auth/abstract_oauth.py", line 222, in _make_handled_request response.raise_for_status() File "/usr/local/lib/python3.11/site-packages/requests/models.py", line 1024, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: appleid.apple.com/auth/oauth2/token?grant_type=client_credentials&scope=searchadsorg 2026-09-23 141007 error Check failed 2026-09-23 141007 info Checking for optional control message... 2026-09-23 141007 info Writing output of e59c8416-c2fa-4bd3-9e95-52677ea281c1_984f267d-d3c3-4f30-a28f-a4941e7548a5_0_check to the doc store 2026-09-23 141008 info Marking workload e59c8416-c2fa-4bd3-9e95-52677ea281c1_984f267d-d3c3-4f30-a28f-a4941e7548a5_0_check as successful 2026-09-23 141008 info Deliberately exiting process with code 0. 2026-09-23 141008 info 2026-09-23 141008 info ----- END CHECK ----- 2026-09-23 141008 info

@kapa.ai When a sync fails (e.g., due to an image pull failure from the registry) with zero records synced, Airbyte is still reporting the sync status as Successful. It should be marked as Failed so failures aren't missed. Why would that be the case ?

@kapa.ai , there is an issue in reading table schema when clickhouse version 26.8 is used through the connector , is there a bug /change we are missing?

@kapa.ai For a sync to an azure blob storage. Is this scenario technically possible: I start a incremental append sync, to a custom defined namespace (blob folder). Then after a full refresh, I let the incrementsl syncs happen ata different folder , because I change the custom namespace format, and the fresh data will be placed there, without affecting aany other files in that folder that were before

In the same airbyte connector, is it possible to write to different destination schemas or custom table names?

@kapa.ai Encontrei um bug no

pod-sweeper.sh

rodando no GKE e queria saber se isso já é conhecido / rastreado em algum lugar. Ambiente: Airbyte self-hosted v1.4.1 (helm chart), cluster GKE com Image Streaming habilitado (node pool com kubelet recente). Causa raiz: o kubelet do GKE agora injeta uma PodCondition sintética chamada ImageStreaming como conditions[0], sempre com lastTransitionTime: null — não é uma condição de ciclo de vida real, é só informativa. O pod-sweeper.sh lê conditions[0].lastTransitionTime e cai no fallback do bash ${POD_DATE_STR:-$POD_START_DATE_STR} quando está vazio — só que a string literal "null" não é tratada como vazia por esse fallback, então POD_DATE_STR acaba sendo literalmente "null", o date -d null falha, e o sweeper nunca envelhece o pod. Resultado: os pods acumulam no namespace em vez de serem limpos. Proposta de fix :

[ "$POD_DATE_STR" = "null" ] && POD_DATE_STR=""
[ "$POD_START_DATE_STR" = "null" ] && POD_START_DATE_STR=""
POD_DATE=`date -d ${POD_DATE_STR:-$POD_START_DATE_STR} '+%s'`

Isso já é um problema conhecido? Já existe fix original ou alguma versão que resolve?

@kapa.ai, How can I move the destination schema used while keeping all the history/etc?

@kapa.ai are faster syncs coming to mssql to GBQ?