Hey! Any updates on this? Now my connection with shopify is almost not bringing data at all

Hi team! I’m trying to build the airbyte-workers image, but unfortunally I’m not able to do it anymore… do something change on the latest code? btw, I’m using this command:

./gradlew :airbyte-workers:build

Hi all, I am trying to connect Oracle to snowflake and creating a new connection after adding source and destination On clicking Setup connection i am getting "The connection tests failed. non-json response " error . any idea how to troubleshoot this

Hi team, I’m running Airbyte 0.40.25 on GKE and my installation is failing to launch new pods. I thought it might be a temporal issue, so I upgraded temporal to

airbyte/temporal-auto-setup:1.13.0

. But am still having the same issue.

Hi team! I wonder if someone already deploy Airbyte on kubernets and its works. I glad to know if you can share the configuration of the pods and what kind of machine do you use! Thanks! Ignacio.

👋 Hey all, I’m trying to look into possibly using airbyte for a few different things. One of the most impactful ones could potentially be a lakehouse -> DynamoDB connection. It seems like both the sources and sinks needed for this are available, but I was curious on the DynamoDB destination / connecter. 1. What’s the max performance we should expect, Assuming no partitioning or provisioning concerns? Our current solution is able to surpass over 15000 item writes / second and was hoping for something within that order of magnitude. The connector only mentioned provisioning concerns, but at the scale I’m looking at it may depend more on the implementation than the table settings. 2. It seems like the destination output schema is relatively fixed with airbyte id = PK, sync time = sort key, then a json blob of the actual data, etc. For performance reasons we need to use our own schema. Is this something that is generally supported in other airbyte conenctors? 3. I’ve noticed theres several options for building our own connecters. I see that java is one of the options, I was wondering if other JVM are supported as well (EG: Scala, Kotlin). Also, probably outside of scope of the question but I’d love the ability to write one in Rust 😉 Thanks for taking the time to read and consider my noob questions 🙂

Does anyone know how to protect the UI with a user and password using Helm Chart deployment?

Hellooctavia wave, Facebook connector stops operating properly after 4:00 pacific. It says sync succeeded but data is not transmitted into google BigQuery. This does not happen every day, but very often it does. It always happen at the same time. (after 4:00 pm) changing the transmission from incremental append to full refresh and saving it, then changing it back to incremental append fixes the issue temporary but it comes back after a while. without this change, and reset of the data it will keep succeeding but not transmitting any data. Can anyone guide me what is going on here, or if there is a solution to this? Thank You.

Hi all, I’m trying to a sync with the HubSpot connector (using the latest version 0.3.0) and running into a problem: the deals table doesn’t have the line_items populated. I’m using Full/Overwrite for everything. Everything else seems to be syncing over just fine, but the connector isn’t useful to me if you can’t associate products with customers (via deals and line items). Anyone running into this issue? Since the HubSpot connector is GA does that mean I should file an issue in GitHub and someone from Airbyte should look into it? Or are patches still accepted?

Hello. First day w/ Airbyte & so close!! ! Help w/ the Microsoft Dataverse connector: I've successfully created the ClientID & applied perms in my PowerApps/DataVerse env. In AirByte I'm able to create the DataVerse source, seems to 'test' ok. Dest is Azure Blob. Same, seems to test OK w/ my Key. Airbyte connects, reads the schemas of all tables and presents me a list of Dataverse tables to sync. I check the stream for 'account' and click "set up connection" - get "connection tests failed, non-json response". My google-fu is failing me. A search didn't reveal much. Thanks.

Hi i tried installing airbyte on ecs ec2 based cluster not fargate. but faced lot of issue Can i know that if airbyte can on be install on ecs cluster with ec2-type ? if not then what are alternate solutions for container based on aws ? will eks platform will work in production ?

hi 👋 i successfully set up a self-hosted Airbyte instance and everything worked like a charm. ~24 hours later, i keep getting this 500 Error

Internal Server Error: Duplicate key

. tried restarting the container, then deleting & reinstalling the container, and i keep getting the same error. any pointers on how i might resolve this?

hello, what is the best way to change ports on Airbyte? I changed them in ".env" and "docker-compose" files but i see they are hardcoded in some more places. The ports are already used on my machine.

are the Apple Silicon instructions in this guide still relevant? got an error message when trying to the dev version on an M1, and skipping this seems to be fine

Hello. All our airbyte connections are running too long. sometime more than two hours and normalisation step seems to be the issue. Query like below are running for each column up to 5-10 seconds. any suggestions on how to improve this.

/* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.account_ab1"} */
select data_type from SVV_COLUMNS where table_name = '_airbyte_raw_account' and column_name = '_airbyte_data' and table_schema = 'staging';

hi! I wanted to import a configuration file from 0.35.27-alpha to 0.40.25 via UI but I can’t seem to find the import option? can someone point me to the right direction to do this?

hello all, can someone please say if airbyte has Gitlab statistics as one of the sources for destination ? can someone please help me

can someone please guide me in creating a customer connector for airbyte

Which is login api for Airbyte in local, which we can execute in postman?

Hello, It seems that the docs page is not working https://docs.airbyte.com/

I can not find source for Aurora AWS my sql in Airbyte

image.png

any help

Anyone have api for creating datasource by passing database configuration.

Hi, I’d like to ask a question the forum but it does not validate my email address, see below. Can you please fix it ? I swear .co is a valid extension 🙂

Hey, is there a way one can hide the destination button on the panel. We would like the users to only already configured destination. Or an alternative of having destination added not edited

I am still having this issue https://github.com/airbytehq/airbyte/issues/20559 after updating to 0.40.26, can anyone confirm that it is indeed fixed and if I have to do any manual steps on my installation?

2022-12-19 14:07:01 ERROR i.a.w.g.DefaultNormalizationWorker(run):83 - Normalization failed for job 78.
java.lang.NullPointerException: Cannot invoke "String.toLowerCase()" because "this.normalizationIntegrationType" is null
	at io.airbyte.workers.normalization.DefaultNormalizationRunner.normalize(DefaultNormalizationRunner.java:107) ~[io.airbyte-airbyte-commons-worker-0.40.26.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:77) ~[io.airbyte-airbyte-commons-worker-0.40.26.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:34) ~[io.airbyte-airbyte-commons-worker-0.40.26.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.26.jar:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]

Hello airbyte experts, I am exploring airbyte and wanted to install it on EKS. I followed the instructions provided here: https://docs.airbyte.com/deploying-airbyte/on-kubernetes-via-helm But a default installation (without any values.yaml) fails with the error message: failed pre-install: timed out waiting for the condition INSTALLATION FAILED I know I am missing something, could you please guide me?

Hello everyone Some Person can you help me, I have a problem with deploy of airbyte on EKS of AWS, If you have documentation for this processing, I thank you for helping, I have the some problem that @Santhosh Swaminathan but on EKS

Hello ! For some reason, I get errors whenever I'm trying to create a new Snowflake source, or access settings of current Snowflake sources... Any idea what might be wrong?