Hello Developers, I have deployed airbyte on GKE with external DB connected. CPU and memory resources up to mark. Problem is when we make a connection, its failed everytime. Might we issue is with worker in communicating with temporal. Server , worker and temporal logs attached.

Screenshot 2022-07-21 195309.png

Hi Guys, I'm new to airbyte and I recently set up Airbyte open source on my computer to migrate data to our Redshift DWH. I'm having issues setting up Azure Mysql

source

using the MySQL connector on airbyte. I get stuck with the error message 'Check Connection Failed!' - not sure what the problem is Any help on this would be appreciated

Hi everyone, I start building a connector for airbyte, and get all works in my local, but for no reason, when I tried to use my image in the cloud (our own gcp cloud, launch via docker-compose) doesn’t work adding the connector to airbyte UI. Error that is appearing is:

👋 Hello, team! I've setup Airbyte in local mode and trying to load data from Facebook Marketing. When I did the same in Airbyte cloud, I was able to use the login option for my account. But that is not available in local mode. Also the local mode is giving me "deprecated version of API" error. Has anyone experiences this error? If so can you please suggest the solution for this. Thanks in advance!

Hi Team, I need some assistance with mysql source connector to postgres destination. attached logs

Hey I am trying to setup airbyte with GCS and Snowflake to ingest a simple 15GB csv as a first test use case. However, the fetching the schema of your data source steps seems to take surprisingly long 20mins+

- Hello all , am unable to get the interface after installing the it on an EC2 .. here is the log file .. any help is appreciated ..

Hi ,I'm currently using airbyte (version 39.37)for ingesting table from postgresql (version 13) to mysql(version 5.6) when we select sync mode for tables replication Out of 3 sync mode (full refresh append ,full refresh Overwrite,and increment append)only Full refresh append and full refresh overwrite are available in some tables. as we have set increment append for all table But its not seen .Kindly Help me to Resolve issue.

What does this means? I am using API to create a connection

Hi...Team...Can anyone help me how to sync data from mixpanel to postgresql database.I am getting errors while syncing the jobs.

Hello, May someone know why I receive this Error?

Hello, Why am I getting this error while trying to load a CSV file from the local machine?

Hi everyone, I have a project where I try to extract data from gitlab. I have a pipeline that work with meltano as ETL and I want to test Airbyte too to compare both, but I can't set up the source... I use exactly the same params that work with Meltano. Help please.

image.png

Hello! I am currently trying to set up a pipeline with the native Harvest source connector, but I keep running into this Internal Server Error every time I attempt to set up the source? Has anyone else experience this? Any insight would be helpful!

Hi! • Is this your first time deploying Airbyte?: Yes • OS Version / Instance: GKE • Memory / Disk: GKE • Deployment: Kubernetes • Airbyte Version: 0.39.42-alpha • Source name/version: postgresql 10 • Destination name/version: clickhouse • Step: add connection I’m trying to use airbyte to sync data from Postgres to Clickhouse using the available connectors. In the source, the JSON and JSONB fields are showing up as String and not JSON. I also want the JSON fields to be normalized(flattened). Please help me fix this. Image - details and detailsb are JSON and JSONB fields respectively

We are able to establish connection with MSSQL db, but Airbyte unable to fetch the schema as shown below. Can anyone help with this issue?

Hi All, We are trying to deploy airbyte in our on-prem Kubernetes cluster which is hosted on Rancher. Here we are facing couple of issues while deploying airbyte server. 1- One issue is with airbyte-webapp deployment, to airbyte-webapp we are providing an ingress service to access it out side of the cluster. But when we are trying to access it through browser we are facing "502 bad gateway" error as shown in below in screenshot. Could someone please help me out?

Hi team , i Got this error when connect to BQ , not sure which schema validation is error ?

Hi Team, I have a question regarding the Monday connector. We have set up the Airbyte on our server using the docker image. For some reason the connector failed. While doing the troubleshooting I came across something that I want more clarity on. Seems like the logs are being dumped in a s3 bucket that is set to be public. Can someone please help me understand why it is happening and why the logs are kept in an s3 bucket when I have set the permissions to False in the container image? Here is the screenshot from the logs:

Hello everyone 👋! I’m reading that normalization only supports JsonSchema’s primitive types. What would be best practices if I need to preserve non-json types in the destination? In my particular case (PSQL), I have keys as UUIDs and in the destination and Airbyte loads them as text. I don’t want to create DBT models for each table transforming columns to UUID as it would require quite a lot of manual work and maintenance. Any suggestion? Thanks in advance!! 🍻

Hello, I apologize for cross-posting this issue on this channel. It looks like the Authentication channel - where I initially posted may have been archived and perhaps a reason of not getting any response. Again, apologies for the cross-posting. Now, we've deployed airbyte through docker and currently facing a somewhat strange issue. We're attempting to authenticate mongodb as a source, however this only works IF we use the actual IP address of the docker container. However, if we attempt to authenticate using the container name (e.g. apps_percona) it fails. We do have another service using pymongo and authenticating using the container name without a problem, therefore we are thinking this is an issue unique to airbyte. I am attaching abit of the logs below for any help in identifying the issue. FYI - from the airbyte UI we only get this response "The connection tests failed. non-json response". However, as i mentioned earlier we're able to connect via the docker container IP address but optimally we want to use the container name to avoid having to change the airbyte source authentication settings everytime the container is restarted. Any assistance or insight on this will be super appreciated.

Dbt run return

unrecognized arguments

using --vars [Troubleshooting] transformation Is this your first time deploying Airbyte?: No OS Version / Instance: Ubuntu 22.04 Memory / Disk: 8Gb / 80 Gb NVme Deployment: Docker Airbyte Version: 0.40.3 Source name/version: Postgres/1.0.9 Destination name/version: Postgres/ 0.3.24 Step: The issue is happening during sync Description: I created a specific dbt transformation at GitHub - OpenSourcePolitics/dbt_decidim, to transform data fr…

Airbyte kubernetes/helm deployment unable to configure external postgres [Troubleshooting] deploy Is this your first time deploying Airbyte?: Yes OS Version / Instance: Debian GNU/Linux 11 (bullseye) Memory / Disk: you can use something like 4Gb / 1 Tb Deployment: Kubernetes in AWS Airbyte Version: 0.40.3 Step: Deployment to cluster Description: Our team uses automated kubernetes deployments via flux. This is our first deployment of Airbyte utilizing the helm charts. Services are being deplo…