However two major feature are missing in airbyte oss with cdk 1. Selecting fields fromt that source 2. Setting up Cron expression to run sync

Side note : I do understand this is available from airbyte cloud UI level selection

if you can confirm this feature is missing I would like to contribute in open source code to change and add it to review.

I just want to make sure I didnt overlook and this feature is already there

for #2 Its there via Airfflow job or orchestration tool I know

Cross posting this message since I think this is actually the right channel for it! Thank you ❤️ https://airbytehq.slack.com/archives/C021JANJ6TY/p1756922100896179

Hi, I saw the the Klaviyo connector is only supported with API key, not oauth crdentials. Is there any way to change this (in the cloud version)?

Hello, is there a good tutorial to understand how to develop our own destination connector ? We would like to store data as Parquet file in Azure Blob Storage. The parquet format is not available yet in the existing connector. All tutorials I found are related to source connectors and not destination connectors

Hi! I am trying to modify the gmail source connector to pull email attachment information. I have defined a few new data streams but am running into issues with not being able to make the API call to get the attachment. Has anyone run into trouble with making new data streams in existing source connectors?

Hello Team, I am trying the self hosted solution for Airbyte, if i use the 1.8.2 version, i can't connect the source as at the end of connecting i get this error:

{
  "message": "Internal Server Error: not yet implemented",
  "exceptionClassName": "java.lang.UnsupportedOperationException",
  "exceptionStack": [],
  "rootCauseExceptionStack": []
}

1.8.1 isn't installing 1.7.2 uses deprecated google apis V18 Can anyone help ?

Is it only possible to AddFields to a stream based on the output of stream? Is it possible to AddFields from the parent stream at all?

Hey guys! I'm using Airbyte Cloud to develop a new async connector from the UI, for the Amazon Selling Partner API because the reports I need aren’t available yet. I’m stuck on the last step: decoding the gzip response I receive from the API in the response body. I’ve tried using Download HTTP Response Format = GZIP and Decoder = JSON, but it throws the following error:

airbyte_cdk.utils.traced_exception.AirbyteTracedException: Response JSON data failed to be parsed.

Does anyone know how to handle this in Airbyte Cloud, given that we’re not allowed to use custom decoders?

Anyone knows when we can expect connectors with custom components to be avail in cloud?

Hi folks -- is there a way for a connector to have both OAuth and Bearer Token authentication methods? Asking this in the context of the Employment Hero connector. The current version of this on the Airbyte Connector Marketplace is only using Bearer Token authentication, and getting the Bearer Token can be done manually by sending a request from Postman. However, that Bearer Token/API key expires after 15 mins. So if you're going to use this method for a run that happens daily, you will need to manually create the token every day. Which we don't want for obvious reasons. Airbyte does offer OAuth support when building a custom connector in the UI, and I think this can be used for generating the new access token. But passing along that access token for use in Bearer authentication to call the specific endpoints is where I'm getting stuck. After completing the consent step, I get this error:

OAuth login failed: An unexpected error occurred. Please report this if the issue persists. (HTTP 500)

So I'm assuming that it's related to the Bearer Token authentication step. Any ideas on how to resolve this?

Hello Team, I am building a S3 destination connector on top of the current one, so we can enable partitioned parquet files. I am following this tutorial https://docs.airbyte.com/platform/connector-development/tutorials/building-a-java-destination. However, when I try to build the connector

./gradlew :airbyte-integration:connectors:destination-s3:build

, I get the following error.

S3V2WriteTestAvroBzip2Proto > testBasicWrite() FAILED
    java.lang.NoClassDefFoundError: Could not initialize class io.airbyte.integrations.destination.s3_v2.S3V2TestUtils
        at io.airbyte.integrations.destination.s3_v2.S3V2WriteTest.<init>(S3V2WriteTest.kt:52)
        at io.airbyte.integrations.destination.s3_v2.S3V2WriteTest.<init>(S3V2WriteTest.kt:35)
        at io.airbyte.integrations.destination.s3_v2.S3V2WriteTestAvroBzip2Proto.<init>(S3V2WriteTest.kt:412)

        Caused by:
        java.lang.ExceptionInInitializerError: Exception java.nio.file.NoSuchFileException [in thread "ForkJoinPool-1-worker-13"]
            at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:92)
            at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)
            at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
            at java.base/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:261)
            at java.base/java.nio.file.Files.newByteChannel(Files.java:380)
            at java.base/java.nio.file.Files.newByteChannel(Files.java:432)
            at java.base/java.nio.file.Files.readAllBytes(Files.java:3281)
            at java.base/java.nio.file.Files.readString(Files.java:3359)
            at java.base/java.nio.file.Files.readString(Files.java:3318)
            at io.airbyte.integrations.destination.s3_v2.S3V2TestUtils.<clinit>(S3V2TestUtils.kt:45)
            at io.airbyte.integrations.destination.s3_v2.S3V2WriteTest.<init>(S3V2WriteTest.kt:52)
            at io.airbyte.integrations.destination.s3_v2.S3V2WriteTest.<init>(S3V2WriteTest.kt:35)
            at io.airbyte.integrations.destination.s3_v2.S3V2WriteTestCsvUncompressed.<init>(S3V2WriteTest.kt:350)
            at java.base/jdk.internal.reflect.DirectConstructorHandleAccessor.newInstance(DirectConstructorHandleAccessor.java:62)
            at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:502)
            at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:486)
            at org.junit.platform.commons.util.ReflectionUtils.newInstance(ReflectionUtils.java:591)
            at org.junit.jupiter.engine.execution.ConstructorInvocation.proceed(ConstructorInvocation.java:56)
            at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131)
            at org.junit.jupiter.api.extension.InvocationInterceptor.interceptTestClassConstructor(InvocationInterceptor.java:73)
            at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.lambda$invoke$0(InterceptingExecutableInvoker.java:93)
            at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106)
            at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64)
            at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45)
            at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37)
            at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:92)
            at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:62)
            at org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor.invokeTestClassConstructor(ClassBasedTestDescriptor.java:364)
            at org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor.instantiateTestClass(ClassBasedTestDescriptor.java:311)
            at org.junit.jupiter.engine.descriptor.ClassTestDescriptor.instantiateTestClass(ClassTestDescriptor.java:79)
            at org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor.instantiateAndPostProcessTestInstance(ClassBasedTestDescriptor.java:287)
            at org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor.lambda$testInstancesProvider$5(ClassBasedTestDescriptor.java:279)
            at java.base/java.util.Optional.orElseGet(Optional.java:364)
            at org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor.lambda$testInstancesProvider$6(ClassBasedTestDescriptor.java:278)
            at org.junit.jupiter.engine.execution.TestInstancesProvider.getTestInstances(TestInstancesProvider.java:31)
            at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$prepare$1(TestMethodTestDescriptor.java:105)
            at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
            at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.prepare(TestMethodTestDescriptor.java:104)
            at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.prepare(TestMethodTestDescriptor.java:68)
            at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$prepare$2(NodeTestTask.java:123)
            at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
            at org.junit.platform.engine.support.hierarchical.NodeTestTask.prepare(NodeTestTask.java:123)
            at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:90)
            at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute(ForkJoinPoolHierarchicalTestExecutorService.java:202)
            at java.base/java.util.concurrent.RecursiveAction.exec(RecursiveAction.java:194)
            at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387)
            at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.tryRemoveAndExec(ForkJoinPool.java:1351)
            at java.base/java.util.concurrent.ForkJoinTask.awaitDone(ForkJoinTask.java:422)
            at java.base/java.util.concurrent.ForkJoinTask.join(ForkJoinTask.java:651)
            at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService.joinConcurrentTasksInReverseOrderToEnableWorkStealing(ForkJoinPoolHierarchicalTestExecutorService.java:179)
            at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService.invokeAll(ForkJoinPoolHierarchicalTestExecutorService.java:153)
            at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155)
            at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
            at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141)
            at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
            at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139)
            at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
            at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138)
            at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95)
            at org.junit.platform.engine.support.hierarchical.ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute(ForkJoinPoolHierarchicalTestExecutorService.java:202)
            at java.base/java.util.concurrent.RecursiveAction.exec(RecursiveAction.java:194)
            at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387)
            at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312)
            at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843)
            at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808)
            at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188)

I already checked and the

S3V2TestUtils

is actually in the project. But I could not find the reason this is not being copied into the container that runs the tests. Any ideas on why this is happening?

Hi Airbyte team, i've created a discussion for a request for a Reddit Ads connector: https://github.com/airbytehq/airbyte/discussions/66159. I have not received any response on it yet, wondering if this is something you can take on in the near future?

Hey all, I'm struggling with dynamic schema for templates. I've got it working great in simple cases, but not for async. When using AsyncRetriever inside a DynamicSchemaLoader for dynamic stream schema generation, the connector fails with: "ModelToComponentFactory.create_async_retriever() missing 1 required keyword-only argument: 'stream_slicer'" No configuration of stream_slicer, partition_router, or any partition/slicing component works, at least none that I've tried. Use Case: Dynamic schema generation for query streams that return CSV data from async jobs. Need to execute the query during discovery to infer schema from CSV headers. "Automatically import detected schema" doesn't doesn't seem to be valid/working option for stream template generation. Attempted Solutions: - Various "stream_slicer" configurations (ListStreamSlicer, ListPartitionRouter, etc.) - Using partition_router instead - Empty arrays, single values, etc. Environment: Declarative YAML connector using low-code CDK Can anyone point me in the right direction?

Seems to be a bug. Blocking issue for me 👆

I am having this problem with the ClickHouse as a source connector. Does anyone know why it is that way? version:

0.2.4

2025-09-17 13:18:14 source ERROR i.a.c.i.b.AirbyteExceptionHandler(uncaughtException):64 Something went wrong in the connector. See the logs for more details. java.lang.RuntimeException: java.sql.SQLFeatureNotSupportedException: getResultSet not implemented
	at io.airbyte.cdk.db.jdbc.StreamingJdbcDatabase$1.tryAdvance(StreamingJdbcDatabase.java:112) ~[airbyte-cdk-core-0.20.4.jar:?]
	at java.base/java.util.Spliterators$1Adapter.hasNext(Spliterators.java:681) ~[?:?]
	at io.airbyte.commons.util.DefaultAutoCloseableIterator.computeNext(DefaultAutoCloseableIterator.java:42) ~[airbyte-cdk-dependencies-0.20.4.jar:?]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:145) ~[guava-33.0.0-jre.jar:?]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:140) ~[guava-33.0.0-jre.jar:?]
	at io.airbyte.commons.util.LazyAutoCloseableIterator.computeNext(LazyAutoCloseableIterator.java:46) ~[airbyte-cdk-dependencies-0.20.4.jar:?]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:145) ~[guava-33.0.0-jre.jar:?]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:140) ~[guava-33.0.0-jre.jar:?]
	at com.google.common.collect.TransformedIterator.hasNext(TransformedIterator.java:46) ~[guava-33.0.0-jre.jar:?]
	at io.airbyte.commons.util.DefaultAutoCloseableIterator.computeNext(DefaultAutoCloseableIterator.java:42) ~[airbyte-cdk-dependencies-0.20.4.jar:?]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:145) ~[guava-33.0.0-jre.jar:?]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:140) ~[guava-33.0.0-jre.jar:?]
	at io.airbyte.cdk.integrations.source.relationaldb.StateDecoratingIterator.computeNext(StateDecoratingIterator.java:127) ~[airbyte-cdk-db-sources-0.20.4.jar:?]
	at io.airbyte.cdk.integrations.source.relationaldb.StateDecoratingIterator.computeNext(StateDecoratingIterator.java:22) ~[airbyte-cdk-db-sources-0.20.4.jar:?]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:145) ~[guava-33.0.0-jre.jar:?]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:140) ~[guava-33.0.0-jre.jar:?]
	at io.airbyte.commons.util.DefaultAutoCloseableIterator.computeNext(DefaultAutoCloseableIterator.java:42) ~[airbyte-cdk-dependencies-0.20.4.jar:?]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:145) ~[guava-33.0.0-jre.jar:?]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:140) ~[guava-33.0.0-jre.jar:?]
	at com.google.common.collect.TransformedIterator.hasNext(TransformedIterator.java:46) ~[guava-33.0.0-jre.jar:?]
	at io.airbyte.commons.util.DefaultAutoCloseableIterator.computeNext(DefaultAutoCloseableIterator.java:42) ~[airbyte-cdk-dependencies-0.20.4.jar:?]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:145) ~[guava-33.0.0-jre.jar:?]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:140) ~[guava-33.0.0-jre.jar:?]
	at io.airbyte.commons.util.CompositeIterator.computeNext(CompositeIterator.java:74) ~[airbyte-cdk-dependencies-0.20.4.jar:?]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:145) ~[guava-33.0.0-jre.jar:?]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:140) ~[guava-33.0.0-jre.jar:?]
	at io.airbyte.commons.util.DefaultAutoCloseableIterator.computeNext(DefaultAutoCloseableIterator.java:42) ~[airbyte-cdk-dependencies-0.20.4.jar:?]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:145) ~[guava-33.0.0-jre.jar:?]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:140) ~[guava-33.0.0-jre.jar:?]
	at io.airbyte.commons.util.DefaultAutoCloseableIterator.computeNext(DefaultAutoCloseableIterator.java:42) ~[airbyte-cdk-dependencies-0.20.4.jar:?]

I believe the JDBC connector 0.3.2 is outdated and there is 0.6.0 available. How can we upgrade it?

Hello 👋 I just joined the community. Our company (Glowtify) runs Airbyte open-source, self-hosted on GKE, and we’ve been using several connectors. I recently added the LinkedIn Pages connector to our system, and I’d like to extend it with a few more streams to capture more granular post-level stats (since the current streams only provide org-level stats). This is my first time working with the Airbyte source code, and I’m having trouble setting it up locally. Are there any guides on how to set up the environment to start developing a connector?

Hi Team, I’m using a self-hosted setup of Airbyte and have created a connection from MongoDB to BigQuery. While trying to refresh the schema, I’m consistently getting a 502 HTTP error (Airbyte temporarily unavailable). Details: • Source: MongoDB (database size ~200GB) • Destination: BigQuery • Issue: Unable to refresh schema due to 502 error • Tried solutions: Increased node pool size, but the problem still persists My main requirement is to sync this ~200GB MongoDB database into BigQuery, but I’m blocked at the schema refresh step. Attaching a screenshot for reference.

Hi everyone, I need help with the hubspot source connector. I need to fetch the custom objects associations with contacts, deals and tickets just as it is done in other natives objects.

Hey team, We are looking for a person who already connected Google Ads and Google Analytics to a self-hosted instance. We have trouble getting into the authentication (signing with google is deactivated). If you have any ideas of who can help us, happy to discuss. Thanks.

Hi could you review my PR? We have a pressing project that requires to move data from Clickhouse to Postgres: https://github.com/airbytehq/airbyte/pull/66482

Can anyone please help me troubleshoot the Facebook Marketing connector? Things have matched the Facebook Ads manager ever since we started using it 6 months ago but on 9/11/25 we started to see our numbers be under-reported. If I call the Facebook Ads Insights API directly with the following curl I get the correct amount so I'm curious how the Airbyte Connector is fetching data. Thanks!

curl -G \
  -d "access_token=MYTOKEN" \
  -d "time_range={'since':'2025-09-16','until':'2025-09-16'}" \
  -d "fields=conversions" \
  "<https://graph.facebook.com/v23.0/MYADNUMBER/insights>"

hi everyone, we have built one connector and made a docker image out of it then when we try to add this image through Airbyte UI by providing image then it can't link up to that image, i believe the reason is since airbyte uses abctl(kubertesis) and docker image is hosted in my local, so they have diferent daemon and i can't load this docker image via kind load also any solution for this ?

Hello Team, Can we test a forked connector of google sheets in airbyte open source 1.7 version? The option to test the custom connector is not working with either a mouse click or ctrl+enter.

hey team, i had installed airbyte locally and it was working fine for me setting up source and destination connector but from 2 days, i am seeing the error - I have reinstalled multiple times, I checked online the issue - it said, Airbyte UI couldn't connect to Backend How this issue can be resolved ?

Can anyone help me building a custom connector for Grapghdb Neo4j, we will be first transforming structure data to graph data, node schema and their relationship will be provided by user in json/yaml file, then we make a connection to Neo4j and write data to graph database