@kapa.ai For a sync to an azure blob storage. Is this scenario technically possible: I start a incremental append sync, to a custom defined namespace (blob folder). Then after a full refresh, I let the incrementsl syncs happen ata different folder , because I change the custom namespace format, and the fresh data will be placed there, without affecting aany other files in that folder that were before

In the same airbyte connector, is it possible to write to different destination schemas or custom table names?

@kapa.ai Encontrei um bug no

pod-sweeper.sh

rodando no GKE e queria saber se isso já é conhecido / rastreado em algum lugar. Ambiente: Airbyte self-hosted v1.4.1 (helm chart), cluster GKE com Image Streaming habilitado (node pool com kubelet recente). Causa raiz: o kubelet do GKE agora injeta uma PodCondition sintética chamada ImageStreaming como conditions[0], sempre com lastTransitionTime: null — não é uma condição de ciclo de vida real, é só informativa. O pod-sweeper.sh lê conditions[0].lastTransitionTime e cai no fallback do bash ${POD_DATE_STR:-$POD_START_DATE_STR} quando está vazio — só que a string literal "null" não é tratada como vazia por esse fallback, então POD_DATE_STR acaba sendo literalmente "null", o date -d null falha, e o sweeper nunca envelhece o pod. Resultado: os pods acumulam no namespace em vez de serem limpos. Proposta de fix :

[ "$POD_DATE_STR" = "null" ] && POD_DATE_STR=""
[ "$POD_START_DATE_STR" = "null" ] && POD_START_DATE_STR=""
POD_DATE=`date -d ${POD_DATE_STR:-$POD_START_DATE_STR} '+%s'`

Isso já é um problema conhecido? Já existe fix original ou alguma versão que resolve?

@kapa.ai, How can I move the destination schema used while keeping all the history/etc?

@kapa.ai are faster syncs coming to mssql to GBQ?

@kapa.ai Hey — running into a weird MongoDB CDC issue on self-hosted Airbyte (v1.8.3, source-mongodb-v2) and hoping someone's seen this before. We had 21 MongoDB source connections (single-database CDC, 30-min sync schedule) that all got recreated at once after a reset. They ran fine for a while, then started failing with

Saved offset is not valid

/ oplog history lost errors — but the timing was weird: it failed almost exactly when our configured oplog retention ran out. We bumped retention from 24h to 72h thinking that'd fix it... and it just failed again 3 days later, same error. So we dug into the actual sync logs, and found the saved resume token's timestamp was ~72 hours old — meaning the checkpoint hadn't moved forward at all in ~144 sync runs, even though those syncs were reporting success. Bumping retention just delayed the same failure, it didn't fix anything. We ruled out a connector version bug (checked 2.0.2 vs 2.0.7, both pin the exact same CDK and Debezium versions, so no code difference there). Best guess right now is something about Debezium's heartbeat not properly refreshing the saved offset for quiet/low-write databases, especially since Airbyte restarts a fresh Debezium process every single sync instead of running it continuously. Has anyone hit this — offset going stale in roughly the same time as your oplog retention no matter what you set it to, especially after mass-recreating a bunch of CDC connections at once? Trying to figure out if this is a known Debezium/Airbyte interaction or something specific to our setup.

Your connection MongoDb GL Connect prod → Snowflake GL Connect PROD from MongoDb GL Connect prod to Snowflake GL Connect PROD just failed... This happened with SQL compilation error: invalid type [CAST(CONNECTORINSTANCES.XSLT_CONFIGS AS OBJECT)] for parameter 'TO_OBJECT'

@kapa.ai Failure in source: Exhausted available request attempts. Please see logs for more details. Exception: Gmail returned a per-user or per-project quota saturation 403 (rateLimitExceeded / userRateLimitExceeded). Honouring

Retry-After

and retrying — the sync will resume once Gmail’s rolling quota window frees up. how to increase limit

@kapa.ai can you use file connector to direct copy excel file from a URL to S3?

Hi @kapa.ai, I am trying to collect the sync logs into Loki. In my case I added labels and annotations as below, to both the worker and server. While the logs for both worker and server are successfully collected, the

replication-job

pod logs are not. Seems to be the case where the the vector label is not being injected into the replication-job pods, which is similar to this github.com/airbytehq/airbyte/issues/33068 issue. I'm currently on airbyte 1.8.5; is there any workaround or solution to this?

# -- Add extra annotations to the worker pods
  podAnnotations:
    vector.dev/sinks: loki

  # -- Add extra labels to the worker pods
  podLabels:
    vector.dev/include: "true"

HI Team, We started to see the exchange rate API failing with below error from today; Could you please help me to fix; it was working fine yesterday; And we didn't do any infra changes recently

2026-09-29 04:31:20 [32mINFO[m i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/80261/0/logs.log
2026-09-29 04:31:20 [32mINFO[m i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.28
2026-09-29 04:31:20 [32mINFO[m i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation
2026-09-29 04:31:21 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 -
2026-09-29 04:31:21 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK -----
2026-09-29 04:31:21 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 -
2026-09-29 04:31:21 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-exchange-rates:1.2.7 exists...
2026-09-29 04:31:21 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-exchange-rates:1.2.7 was found locally.
2026-09-29 04:31:21 [32mINFO[m i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = source-exchange-rates-check-80261-0-lpmmh with resources io.airbyte.config.ResourceRequirements@4047ce63[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
2026-09-29 04:31:21 [32mINFO[m i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/80261/0 --log-driver none --name source-exchange-rates-check-80261-0-lpmmh --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/source-exchange-rates:1.2.7 -e WORKER_JOB_ATTEMPT=0 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=80261 airbyte/source-exchange-rates:1.2.7 check --config source_config.json
2026-09-29 04:31:21 [32mINFO[m i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0
2026-09-29 04:32:24 [32mINFO[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Ping response code: 504
2026-09-29 04:32:24 [1;31mERROR[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):116 - Check failed
2026-09-29 04:32:24 [32mINFO[m i.a.w.g.DefaultCheckConnectionWorker(run):110 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@5452dc14[status=failed,message=JSONDecodeError('Expecting value: line 1 column 1 (char 0)')]
2026-09-29 04:32:24 [32mINFO[m i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2026-09-29 04:32:24 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 -
2026-09-29 04:32:24 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK -----
2026-09-29 04:32:24 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 -
2026-09-29 04:32:25 [32mINFO[m i.a.c.f.EnvVariableFeatureFlags(autoDisablesFailingConnections):27 - Auto Disable Failing Connections: false

@kapa.ai, we are getting this error trying to sync MySql->Snowflake:

[config_error] MySQL Timezone Configuration Issue: The sync encountered a timezone configuration issue. Please configure your database with the correct timezone as specified in the error message. For more details, refer to: <https://dev.mysql.com/doc/refman/8.4/en/time-zone-support.html>.
<https://docs.oracle.com/javase/8/docs/api/index.html?java/io/SQLException.html>

@kapa.ai Is there a way to read an Excel file from Sharepoint and load it in to a Databricks table

What suggestions do you have for syncs to consume more wal for postgres cdc? My cdc set up can't catup with the amount of wal being generated. I added the heartbeat, and tweaked the initial wait time seconds, but it doesn't seem to have worked. The max wal keep size limit is 2TB but once the full refresh is done is at 1TB+ in 4-5 hrs.

I have an S3 data source in Airbyte Cloud. Every day a full overwrite data set is delivered to this bucket, under a directory with the date and time. I can successfully consume the first file, but is there a way to either only retrieve the most recently modified file, or to use something like a current date in the globs pattern?

@kapa.ai I have a mixpanel to bigquery connection and it is SO slow when it syncs. it often takes around 2 and a half hours to load about 200 records. what is going on and how can i improve it? attached is an example log file from the currently running sync job

@kapa.ai using connection builder, component.py, how do i call aws, i cant seem to include boto3

@kapa.ai Getting error while reading files from gcs to send to snowflake

having a problem with bigquery connection. started after version 1.0.0 is gone live in 2026-10-02

@kapa.ai pod

airbyte-minio-0

com o erro

Back-off pulling image "<http://quay.io/minio/minio:RELEASE.2023-11-20T22-40-07Z|quay.io/minio/minio:RELEASE.2023-11-20T22-40-07Z>"

@kapa.ai does the shopify connector load draft orders?

What are the reasons why cdc syncs won't ingest records except for occasional "burst" syncs that ingest millions of recrods in bulk that would take a few hours to run? This leads to a lot more retained wal

@kapa.ai we were trying to pull the google analytics using the airbyte, we have added 7 to 8 propertyIds in the source but when we were trying to create connection, why the stream name is ending with property<propertyId> also only 1 ID is populating that pattern. is it possible to remove that and get all data in one stream itself?

@kapa.ai Pods are fine: source-gcs-check-0fa76e48-6559-4bff-91ad-4eb066c14a60-0-giwfv 0/2 Completed 0 4m31s source-gcs-check-ca3cfcab-8682-429a-9731-602912315022-0-ujppi 0/2 Completed 0 9m lovelocal@Lovelocals-MacBook-Pro airflow-data-pipelines % But in UI I get error - An unknown error occurred. (HTTP 504)

Airbyte postgres cdc isn't ingesting records except when "burst" syncs happen occasionally. But ingesting of recrods should happne at every sync, obviously there are records being updated during the day. What are the troubleshooting steps I should take on this?

Hi @kapa.ai, how can I fix theses issues on a postgres DB? org.postgresql.util.PSQLException: ERROR: can no longer get changes from replication slot "airbyte_slot" Detail: This slot has been invalidated because it was conflicting with recovery.

Hey @kapa.ai, we need to add hostAliases to the checkSources pods. They don't have a file in helm and I was not able to inject the hostAliases to this temporary pods.

@kapa.ai Did recently Airbyte has any improvement regarding Auto update schema? since i found this message in one of my connection : "Airbyte applied a change in the schema: 1 stream changed." while i didn't do any review schema changes. Usually i need to to review schema changes manually if there's any update regarding the schema

What are some things I can do to avoid this error on postgres cdc? "Replication slot 'your_slot' has advanced beyond the source's state LSN. Confirmed flush LSN: LSN{327F1/C5582CF8}, source LSN: LSN{327F1/C46B8B60}."

Hey everyone I have pure SaaS sites available geekzilla.io softcircles.com kanerika.com Only Li sendbridge.com traffictail.com portotheme.com findarticles.com Gp outrightcrm.com larksuite.com Only Li toolify.ai GP excendra.com