Hi Team, I am trying to run airbyte on a ec2 instance and getting this unknown error and these warnings, does someone know what could be the problem. Thanks! Note that unknow error shows up when clicking on connections button

Hi, great airbyte team. Our infrastructure does not allow to connect internet, may I know any solution to install and run airbyte in air-gap way. Also, we use Kubernetes to deploy airbyte. Thanks.

👋 hello everyone ! I'm trying to use Airbyte to migrate from Postgres to Postgres, across AWS accounts. I've got things set up where I have Airbyte running locally and connecting to both DBs. It repeatably runs through a complete sync (2.5h) and then fails with

An I/O error occurred while sending to the backend.

I'm not quite sure where to look next. Does anyone have any pointers or ideas?

Hello everyone, I successfully deployed Airbyte to Google compute engine and the web app opened on with the server address on my browser. But then I can't access the web app using another PC or browser. Error message is "the site can't be reached" but the site opens on the browser it opened on the first time. Please assist me. Thank you very much.

how to use rabbitMQ as source (airbyte)

how can we implement login in airbyte open source?

Hello everyone. When I create a connection using airbyte-webapp, airbyte shows the database schema in webapp that retrieves from discover_schema API. But I want to show an example of data too, like first 100 record etc. If this isn't possible for every source type , I would like to achieve this for mongoDB at least. Any recommendations?

👋 Hello, team! I would like to ask if Airbyte will sync data both ways? So if I insert data in my destination will Airbyte insert this data into my source?

Hi everyone, is it possible to change data types in auto mapping when creating a connection?

Hey this is my first Airbyte connector and I am having issues with the standard tests. Specifically when running the

./gradlew :airbyte-integrations:connectors:source-employment-hero:integrationTest

command. my build fails. It returns the following error messages.

Building all of Airbyte.

/Users/carlos/Documents/POI/Development/airbyte/airbyte-integrations/connectors

> Task :buildSrc:validatePlugins FAILED

FAILURE: Build failed with an exception.

* What went wrong:

Execution failed for task ':buildSrc:validatePlugins'.

> There was a failure while executing work items

> A failure occurred while executing org.gradle.plugin.devel.tasks.internal.ValidateAction

> Unsupported class file major version 62

* Try:

> Run with --stacktrace option to get the stack trace.

> Run with --info or --debug option to get more log output.

> Run with --scan to get full insights.

* Get more help at <https://help.gradle.org>

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See <https://docs.gradle.org/7.3.1/userguide/command_line_interface.html#sec:command_line_warnings>

BUILD FAILED in 1s

10 actionable tasks: 1 executed, 9 up-to-date

Hey this is my first Airbyte connector and I am having issues with the standard tests. Specifically when running the

./gradlew :airbyte-integrations:connectors:source-employment-hero:integrationTest

command my build fails. It returns the following error messages. Saying that deprecated Gradle features were used in this build, making it incompatible with the Gradle 8.0.

Building all of Airbyte.

/Users/carlos/Documents/POI/Development/airbyte/airbyte-integrations/connectors

> Task :buildSrc:validatePlugins FAILED

FAILURE: Build failed with an exception.

* What went wrong:

Execution failed for task ':buildSrc:validatePlugins'.

> There was a failure while executing work items

> A failure occurred while executing org.gradle.plugin.devel.tasks.internal.ValidateAction

> Unsupported class file major version 62

* Try:

> Run with --stacktrace option to get the stack trace.

> Run with --info or --debug option to get more log output.

> Run with --scan to get full insights.

* Get more help at <https://help.gradle.org>

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See <https://docs.gradle.org/7.3.1/userguide/command_line_interface.html#sec:command_line_warnings>

BUILD FAILED in 1s

10 actionable tasks: 1 executed, 9 up-to-date

My Java is version -> 18.0 and python3 -> 3.10.1 Any help would be much appreciated, and apologies if this is the wrong channel.

Looking for some help with the BambooHR connector, is anyone here familiar with it?

Hello Everybody 👋, I'm seeking for help, I've look everywhere and I can't seem to find how to set up GA4 as a source, a View ID is asked for this which, from my understanding, does not exist anymore. Therefore I'am wondering how you guys set up your GA4 sources octavia thanks.

Hello! We’re trying to pull certain data points from Github like Team Memberships, and I just saw that the endpoints were added yesterday, per this commit. We’re using Airbyte cloud, and was just wondering how quickly the integration is updated to reflect these changes? I just re-ran a Sync and am still not seeing those new tables show up in my BigQuery instance.

Is there a means to use Octavia to update airbyte on kubernetes ?

Hi Everyone I want to build the custom connector by Python CDK. And I follow the official docs for python CDK. After running the below command. cd airbyte-integrations/connector-templates/generator When I try to run the next command ./generate.sh It shows me an error While trying to generate a connector, an error occurred on line 38 of generate.sh and the process aborted early. This is probably a bug. Please Help me to figure it out.

I am just starting with Airbyte and am trying to write local csv files to a Mac (Intel chip). I think I have the local mount set up correctly, since I am able to do a read operation. The write operation appears to succeed, but no information is actually written out. Command used: echo ‘{“record”: {“stream”: “testing”, “data”: {“DOB”: “01/02/1988", “First Name”: “John”, “Last NAME”: “Jones”}, “emitted_at”: 1650284493000}’ | docker run -v /Users/eliot/temp:/tmp airbyte/destination-csv write --catalog /tmp/airbyte_catalog.txt --config /tmp/airbyte_write.json Output:

2022-04-24 13:11:28 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=/tmp/airbyte_catalog.txt, write=null, config=/tmp/airbyte_write.json}
2022-04-24 13:11:28 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Running integration: io.airbyte.integrations.destination.csv.CsvDestination
2022-04-24 13:11:28 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Command: WRITE
2022-04-24 13:11:28 INFO i.a.i.b.IntegrationRunner(runInternal):107 - Integration config: IntegrationConfig{command=WRITE, configPath='/tmp/airbyte_write.json', catalogPath='/tmp/airbyte_catalog.txt', statePath='null'}
2022-04-24 13:11:28 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-04-24 13:11:28 INFO i.a.i.d.c.CsvDestination$CsvConsumer(<init>):139 - initializing consumer.
2022-04-24 13:11:28 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):63 - Airbyte message consumer: succeeded.
2022-04-24 13:11:28 INFO i.a.i.d.c.CsvDestination$CsvConsumer(close):178 - finalizing consumer.
2022-04-24 13:11:28 INFO i.a.i.d.c.CsvDestination$CsvConsumer(close):194 - File output: /local/airbyte_out/_airbyte_raw_testing.csv
2022-04-24 13:11:28 INFO i.a.i.b.IntegrationRunner(runInternal):153 - Completed integration: io.airbyte.integrations.destination.csv.CsvDestination

Created output % more /Users/eliot/temp/airbyte_out/_airbyte_raw_testing.csv “_airbyte_ab_id”,_airbyte_emitted_at,_airbyte_data What am I doing wrong? (Also, trying to go through the Pokemon example through the OpenSource framework example I cannot find my output file either…). Thanks, Eliot

Hi , I created my first source connector and mistakenly uploaded it twice to the UI . How can I remove/delete the custom connector from the available sources in the UI ? Thanks!

Hello, we are installing Airbyte on a private GKE using kustomize. We have put the webapp service behind an ingress and set up IAP in front of the ingress to secure the access. The UI is accessible via the domain we have set up but once we want to interact with Airbyte (for instance to create a new connection), we get the following error: " Cannot reach server. The server may still be starting up." And If we go in the chrome developer console, here are the logs:

Cannot reach server. The server may still be starting up.

image.png

I haven't got an answer on this question: https://airbytehq.slack.com/archives/C021JANJ6TY/p1649833750491429 Where can I get more info on that?

Hello. I am trying to sync 200-300 tables in a connection from postgres to bigquery. I am using n2 compute engine. When I am running a sync for almost an hour airbyte webapp doesn't respond. It shows

Cannot reach server. The server may still be starting up.

. Also after that when the webapp responds the sync fails. Also the records are emitted but not commited to destination. Also I tried changing

JOB_MAIN_CONTAINER_MEMORY_LIMIT

to 7g. I am getting different errors in log for diffrent attempts. I am sharing them below.

Hi Team, I am trying to do MYSQL cdc to kafka. I am not getting the incremental option in the sync type while building connection. Please look at the below screenshot. Need your help.

Hello Awesome Airbyte Team! How do you create a view with the latest record in Airbyte? Is it via the latest _airbyte_date? Thanks!_

Hey team, I am trying to make a simple change in airbyte-integrations (specifically changing the Debezium 5 min wait time to 1 min). What steps would I need to take for my local

docker-compose

to pick this change up? I did go through developing-locally but unsure where I need to edit/add these lines?

SUB_BUILD=PLATFORM ./gradlew build
VERSION=dev docker-compose up

Is there support for dynamodb as a source?

or is there also a way to bring in segment data as source?

Hey all - does anyone know if Airbyte Cloud allows users to implement their own custom connectors? If so, how is that configured?

Hello team, I am running airbyte locally is there a way for airbyte to support snowflake service account( public key/private key and pass phrases”