https://linen.dev logo
Join Slack
Powered by
# ask-ai
  • a

    Aviad Deri

    12/11/2025, 2:21 PM
    @kapa.ai on google gke installation, in mssql source pod i see errors in log: 2025-12-11 141858,280 [main] INFO i.m.r.Micronaut(start):183 - No embedded container found. Running as CLI application Exception in thread "main" io.micronaut.context.exceptions.BeanInstantiationException: Error instantiating bean of type [io.airbyte.workers.workload.WorkloadOutputWriter] Message: /secrets/gcs-log-creds/gcp.json Path Taken: new @j.i.Singleton i.a.c.ConnectorWatcher(@Named("output") Path outputPath, @Named("configDir") String configDir, @Value int fileTimeoutMinutes, @Value int fileTimeoutMinutesWithinSync, SidecarInput sidecarInput, ConnectorMessageProcessor connectorMessageProcessor, AirbyteMessageSerDeProvider serDeProvider, AirbyteProtocolVersionedMigratorFactory airbyteProtocolVersionedMigratorFactory, GsonPksExtractor gsonPksExtractor, WorkloadApiClient workloadApiClient, WorkloadOutputWriter outputWriter, SidecarLogContextFactory logContextFactory, HeartbeatMonitor heartbeatMonitor, MetricClient metricClient) \---> new @j.i.Singleton i.a.c.ConnectorWatcher(@Named("output") Path outputPath, @Named("configDir") String configDir, @Value int fileTimeoutMinutes, @Value int fileTimeoutMinutesWithinSync, SidecarInput sidecarInput, ConnectorMessageProcessor connectorMessageProcessor, AirbyteMessageSerDeProvider serDeProvider, AirbyteProtocolVersionedMigratorFactory airbyteProtocolVersionedMigratorFactory, GsonPksExtractor gsonPksExtractor, WorkloadApiClient workloadApiClient, [WorkloadOutputWriter outputWriter], SidecarLogContextFactory logContextFactory, HeartbeatMonitor heartbeatMonitor, MetricClient metricClient) \---> new @j.i.Singleton i.a.w.w.WorkloadOutputWriter([@Named("outputDocumentStore") StorageClient storageClient], AirbyteApiClient airbyteApiClient, MetricClient metricClient) at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2352) at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3150) at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:3000) at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2762) at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1781) at io.micronaut.context.AbstractBeanResolutionContext.getBean(AbstractBeanResolutionContext.java:210) at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2130) at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForConstructorArgument(AbstractInitializableBeanDefinition.java:1360) at io.airbyte.workers.workload.$WorkloadOutputWriter$Definition.instantiate(Unknown Source) at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2337) at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3150) at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:3000) at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2762) at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1781) at io.micronaut.context.AbstractBeanResolutionContext.getBean(AbstractBeanResolutionContext.java:210) at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2130) at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForConstructorArgument(AbstractInitializableBeanDefinition.java:1360) at io.airbyte.connectorSidecar.$ConnectorWatcher$Definition.instantiate(Unknown Source) at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2337) at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3150) at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:3000) at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2762) at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1781) at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:855) at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:847) at io.airbyte.connectorSidecar.ApplicationKt.main(Application.kt:25) at io.airbyte.connectorSidecar.ApplicationKt.main(Application.kt) Caused by: java.nio.file.NoSuchFileException: /secrets/gcs-log-creds/gcp.json at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:92) at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) at java.base/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:261) at java.base/java.nio.file.Files.newByteChannel(Files.java:380) at java.base/java.nio.file.Files.newByteChannel(Files.java:432) at java.base/java.nio.file.Files.readAllBytes(Files.java:3281) at io.airbyte.commons.storage.StorageClientKt.gcsClient(StorageClient.kt:544) at io.airbyte.commons.storage.GcsStorageClient.<init>(StorageClient.kt:272) at io.airbyte.commons.storage.StorageClientFactory.create(StorageClient.kt:72) at io.airbyte.connectorSidecar.config.ApplicationFactory.workloadStorageClient(ApplicationFactory.kt:18) at io.airbyte.connectorSidecar.config.$ApplicationFactory$WorkloadStorageClient0$Definition.instantiate(Unknown Source) at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2337) ... 29 more what is the issue?
    k
    • 2
    • 1
  • p

    Py Bot

    12/11/2025, 5:34 PM
    when I backfill for 30 days, can I upload it to different folder strcutures in s3?
    k
    • 2
    • 1
  • l

    Lucas Segers

    12/11/2025, 5:41 PM
    I have a stream with incremental sync configured pagination is also configured however, when the page comes "empty", airbyte errors because I'm trying to add a field but it seems to fail if there are no records in the stream_slice airbyte_cdk.sources.concurrent_source.stream_thread_exception.StreamThreadException: Exception while syncing stream posicao_carteira: 'NoneType' object does not support item assignment
    k
    • 2
    • 4
  • o

    Omree Gal-Oz

    12/11/2025, 5:51 PM
    @kapa.ai I have transient errors after restarting many connections at once. Is this expected behavior?
    k
    • 2
    • 1
  • g

    Gideon Stowell

    12/11/2025, 10:45 PM
    @kapa.ai I am seeing these errors in the airbyte server logs, what does it mean?
    Copy code
    2025-12-11 22:44:20,021 [io-executor-thread-4]    WARN    i.a.c.j.JsonSchemas(traverseJsonSchemaInternal):203 - The object is a properties key or a combo keyword. The traversal is silently stopped. Current schema: {"type":"object","ai ││ rbyte_hidden":true,"additionalProperties":true}
    k
    • 2
    • 4
  • a

    Amit Kumar

    12/12/2025, 2:53 AM
    @kapa.ai while setting up embedded flow inside my system can this be white labeled ? Branding should be of my system only and airbyte should not come anywhere in the onboarding flow
    k
    • 2
    • 1
  • a

    Abhijith C

    12/12/2025, 5:35 AM
    @kapa.ai Where should we configure Airbyte Heartbeat. or where is this flag.yaml I have airbyte deployed in EKS via helm. Does it go under values.yaml?
    k
    • 2
    • 1
  • a

    Aviad Deri

    12/12/2025, 5:37 AM
    @kapa.ai i see this error in the logs Error from server: Get "https://172.19.0.2:10250/containerLogs/airbyte-abctl/airbyte-abctl-server-6b77cd774b-hqlwx/airbyte-server-container": dial tcp 172.19.0.210250 connect: connection refused what is the issue?
    k
    • 2
    • 16
  • r

    Rahul

    12/12/2025, 6:01 AM
    @kapa.ai How I can give the tab names in Excel file formate when creating Microsoft Sharepoint source in Airbyte OSS?
    k
    • 2
    • 4
  • h

    Harsh Dodiya

    12/12/2025, 6:12 AM
    Hey @kapa.ai, I have setup the Airbyte using abctl in my VM (with 4 CPU and 32 GB Memory) I am trying to sync from MySQL to PostgreSQL DB. But when we try to sync a large table, Airbyte caches a large number of records from the source connection. Because of that the replication-orchestrator pod kubernetes experiences excessive memory consumption during syncs. We can clearly see it on Pod status:
    Copy code
    airbyte-abctl replication-job-662-attempt-0 0/3 Error 0 4h24m
    airbyte-abctl replication-job-690-attempt-0 2/3 OOMKilled 0 9m15s
    As I installed Airbyte using abctl, but I didn’t set any resource limits during the installation. Now I’d like to adjust the memory allocation and apply new resource limits. Is there a way to update these settings after installation, or do I need to reinstall Airbyte to change them?
    k
    • 2
    • 1
  • p

    Phan Hong Dat (K18 HL)

    12/12/2025, 7:18 AM
    @kapa.ai Airbyte OSS hỗ trợ chạy trong môi trường không ? tôi bị lỗi khi https://pypi.org/pypi/airbyte-cdk/json gọi tới api này
    k
    • 2
    • 1
  • p

    Phan Hong Dat (K18 HL)

    12/12/2025, 7:23 AM
    @kapa.ai I’m getting
    ERR_NAME_NOT_RESOLVED
    and
    Failed to fetch
    errors because the UI is trying to request PyPI URLs. Is there an official way to run Airbyte fully offline or disable these external network checks?
    k
    • 2
    • 1
  • p

    Py Bot

    12/12/2025, 8:22 AM
    how to run previous day pipeline in airbyte using cron
    k
    • 2
    • 1
  • c

    Cal wsoo

    12/12/2025, 9:18 AM
    @kapa.ai airbye T functionality within ETL?
    k
    • 2
    • 1
  • a

    Abhishek Batra

    12/12/2025, 1:19 PM
    @kapa.ai, how to create replicated tables and on cluster in clickhouse using the airbyte clickhouse connector
    k
    • 2
    • 1
  • k

    Kothapalli Venkata Avinash

    12/12/2025, 1:39 PM
    @kapa.ai, Can we connect as400 db2 source using existing Airbyte DB2 connector?
    k
    • 2
    • 4
  • f

    Francisco Carneiro

    12/12/2025, 1:44 PM
    @kapa.ai, any visibility of when this issue will be solved of if there are any workarounds (https://github.com/airbytehq/airbyte/issues/55846).
    Copy code
    In summary the CDC collect fails with this error:
    Saved offset is before replication slot's confirmed lsn. Please reset the connection, and then increase WAL retention and/or increase sync frequency to prevent this from happening in the future. See <https://docs.airbyte.com/integrations/sources/postgres/postgres-troubleshooting#under-cdc-incremental-mode-there-are-still-full-refresh-syncs> for more details.
    Even though the WAL retention is maximum and not that much time passed between two syncs (very little actually)
    k
    • 2
    • 1
  • h

    Harrison Hammond

    12/12/2025, 2:17 PM
    @kapa.ai How do I setup my self hosted instance of airbyte to get data from share point
    k
    • 2
    • 1
  • s

    Slackbot

    12/12/2025, 2:46 PM
    This message was deleted.
    k
    • 2
    • 1
  • j

    Jason Wiener

    12/12/2025, 4:26 PM
    @kapa.ai What's the preferred way to get maintainer review of this pending PR that passes all unit tests but needs integration tests run by someone with access to credentials?
    k
    • 2
    • 1
  • r

    Rafael Felipe

    12/12/2025, 5:07 PM
    mongodb self-hosted...warn before error:
    Copy code
    280 Unable to query for op log stats, exception: {}Command failed with error 13 (Unauthorized): 'not authorized on local to execute command { collStats: "<http://oplog.rs|oplog.rs>", $db: "local", lsid: { id: UUID("a21208b4-bb4a-4dad-8470-990f6af66e19") } }' on server
    k
    • 2
    • 1
  • g

    Gideon Stowell

    12/12/2025, 5:19 PM
    @kapa.ai i am noticing that my 3 airbyte server pods are running at nearly 4GB of memory almost all the time. I am running version 1.7.2. Is this normal?
    k
    • 2
    • 1
  • r

    Rafael Felipe

    12/12/2025, 5:50 PM
    before mondb error: 2025-12-12 144905 destination INFO main i.a.c.i.d.a.FlushWorkers(close):227 Waiting for all streams to flush. 2025-12-12 144906 destination INFO main i.a.c.i.d.a.FlushWorkers(close):226 REMAINING_BUFFERS_INFO
    k
    • 2
    • 1
  • k

    Kevin O'Keefe

    12/12/2025, 7:29 PM
    @kapa.ai I am having issues when adding a google ads source in airbyte oss. I can authenticate fine with the google ads token, but when I click set up source I get a 504 error. I am filtering to one customer ID but I believe that the front end is timing out before the source is completely queried and created.
    k
    • 2
    • 1
  • t

    Tanuja

    12/12/2025, 7:34 PM
    Subject: Setting workspace-level concurrent sync limits in Airbyte Cloud Hi team! I’m looking for a way to limit the number of concurrent syncs at the workspace level in Airbyte Cloud to comply with our constraints (e.g., max 3 concurrent syncs). What I need: A way to ensure we never exceed X concurrent syncs (e.g., 3) across our entire workspace, regardless of how syncs are triggered (scheduled, manual, API, or Airflow). Questions: 1. Does Airbyte Cloud support setting a workspace-level concurrent sync limit? 2. If yes, where can I configure this (UI/API/CLI)? 3. If not available in UI, can this be configured on your backend for our workspace?
    k
    • 2
    • 1
  • k

    Kevin O'Keefe

    12/12/2025, 8:02 PM
    @kapa.ai Deploying v2 helm chart and receive this error mapping key "DATAPLANE_CLIENT_ID_SECRET_KEY" already defined at line 24 line 220: mapping key "DATAPLANE_CLIENT_SECRET_SECRET_KEY" already defined at line 25
    k
    • 2
    • 1
  • j

    Jerry Bao

    12/12/2025, 8:22 PM
    @kapa.ai Is there a way to set the schedulerName for airbyte jobs running in kubernetes? I would like to enable bin packing of jobs
    k
    • 2
    • 1
  • o

    Omree Gal-Oz

    12/12/2025, 11:06 PM
    @kapa.ai why does airbyte force non-legacy state messages in Airbyte 2.0+
    k
    • 2
    • 5
  • k

    Kevin O'Keefe

    12/12/2025, 11:45 PM
    @kapa.ai how can I configure source connector test timeouts. My google ads times out at 30 seconds
    k
    • 2
    • 4
  • m

    Mohammad Atif

    12/14/2025, 7:29 AM
    @kapa.ai i dont see login page in my my self hosted aibyte setup using helm
    k
    • 2
    • 2