Hey Guys, and these error:

For more details see Big Query Error collection: BigQueryError{reason=invalidQuery, location=query, message=Field cod_acao has incompatible types. Configured schema: float; Avro file: integer.}:

Do you know what happend?

Hi guys. I have set up a Pinterest-s3 connection on airbyte and selected Incremental Sync operation. On every sync, data between last sync date and current sync date is being replicated. Is there any way to get the last 7 days or 30 days data in every sync?

Hi Team, Does Airbyte OSS support Authentications for user login, if not is this in our roadmap ?

Hi Guys, am trying to setup airbytes docker but currently port 9000 is taken (by clickhouse) besides changing in the yaml for airbytes worker where else should I change to make it work ? thank you in advance

I’ve just upgraded the mysql source from

0.6.12

to

1.0.1

(GA i believe) and it seems a mess. Running into production syncing issues now • cannot handle separate streams;

Cannot *drop*

*column* '_AIRBYTE_UNIQUE_KEY' which belongs *to* a clustering key

•

Numeric value 'true' *is* not recognized

in the SCD normalization process. i’ve created issues here and here. But the most pressing issue is that we can’t revert back to

0.6.12

without still experiencing the same issue across all connectors

Hello everyone, I'm facing a problem regarding Airbyte. Can anyone help? Fetching data from shopify and sending it to Big Query. We are fetching orders data and transaction data from shopify account. Now the amount of total

orders

data fetched is

71,613 committed records

. But total

transaction

data fetched is

11,134 committed records

. But the number was supposed to be same. We fetched orders data and transaction data together and also separately, but the result is same. Transaction data’s are not getting fetched totally. Can't seems to find the reason behind this. Can anyone please help? AirByte is hosted in one of our cloud machines and the configs are: • OS Version / Instance: Ubuntu 22.04 x64 • Memory / Disk: 8Gb / 160 Gb • Deployment: Docker • Airbyte Version: 0.40.8 • Source name/version: Shopify • Destination name/version: Big Query i have attached the log files.

Are the API endpoints working as expected? updating a connector seems to get overwritten when you

reset

the connector jobs and perform a clean sync

Hi guys, I have deployed Airbyte to Kubernetes to collect data from some sources to my local volume. However, Local Csv and Json Connectors are not working as stated in their description pages. Can someone guide me to do this? Is the Minio a safe solution?

can i see ERD (entity relationship diagram ) for any source ?

i want to see ERD for okta source

Hello guys ! Is there any uptodate and maintained changelog for postgres connector avail somewhere ? It was super to have it on the connector documentation page but it's not updated anymore (since the 0.4.8) Have a nice day !

Hello Folks, I am getting the below error while creating a Destination connection and the destination DB is MariaDB. Can somebody help me on the below error? Could not connect with provided configuration. HikariPool-1 - Connection is not available, request timed out after 60002ms. NOTE: With the same credentials, I am able to create a Source connection, but why I am not able to create a destination connections where its working fine with source connections and credentials are same for destination and source.

Hello guys, Could anyone let me know what will be the configuration to make this worker logs storage to GCS bucket. # Cloud Storage Configuration WORKER_LOGS_STORAGE_TYPE=MINIO WORKER_STATE_STORAGE_TYPE=MINIO thanks.

Hello ! I'm trying to test the low-code CDK to build a connector, but it seems to be failing at the

python main.py spec

step... basically this is the error I get

FileNotFoundError: [Errno 2] No such file or directory: '/Users/alexc/Documents/GitHub/airbyte/airbyte-integrations/connectors/source-zendesk-sell/source_zendesk_sell/./source_zendesk_sell/zendesk_sell.yaml'

I'm guessing that there's some kind of issue with the setup, and it's looking at a sub sub folder rather than at a subfolder, but I'd rather not touch main.py and break anything... Any help? Thanks 🙂

Hello! I recently upgraded from 0.40 to 0.40.10.. and I no longer see the STATE data in settings tab for a connection. Was this removed? Is there anyplace in UI where it can be seen?

hello i'm trying to test a simple connection to mysql, it's a new installation with docker State code: 08001; Message: CLIENT_PLUGIN_AUTH is required

hello their any updates on mongodb CDC and change stream support?

Hello, we are resynchronizing our Aramis Group data on airbyte by making a post on /api/v1/connections/sync giving the connection_id, but sometimes it's just 1 stream name that crashes and not all from the same connection, would it be possible to launch a sync only on a specific stream name?

Any assistance with this would be greatly appreciated - thread here

When are the helm charts updated? It doesn't appear to happen on merge to master, since there are fixes that went in a week ago that have still not been released.

Hi all, I’m having some trouble deploying the new

0.40.13

Helm chart into my EKS cluster:

helm upgrade --install airbyte airbyte/airbyte --debug --namespace airbyte --version 0.40.13

It looks like the

minio

pod is waiting on some PVCs, but the PVC is waiting on the

minio

pod:

❯ k describe persistentvolumeclaim -n airbyte airbyte-minio-pv-claim-airbyte-minio-0                                                                                                                                                                 ✘ 130|
...
Events:
  Type    Reason                Age                   From                         Message
  ----    ------                ----                  ----                         -------
  Normal  WaitForPodScheduled   4m51s (x41 over 14m)  persistentvolume-controller  waiting for pod airbyte-minio-0 to be scheduled

❯ k describe pod -n airbyte airbyte-minio-0
...
Events:
  Type     Reason            Age                 From               Message
  ----     ------            ----                ----               -------
  Warning  FailedScheduling  14s (x24 over 15m)  default-scheduler  0/2 nodes are available: 2 persistentvolumeclaim "airbyte-minio-pv-claim" not found.

Hey Sequence of events: 1. error after running Airbyte on EC2

INTERNAL ERROR: cannot create temporary directory!

2. Then ran

docker system prune

got error

Error response from daemon: failed to prune build cache: write /var/lib/docker/buildkit/containerdmeta.db: no space left on device

3. the output of

sudo du -sh /var/lib/docker/containers/

is 552M Can you please guide what can be next step to run the scripts and clear the server? cc @Jared Rhizor (Airbyte)

Hi all, does this chart version needs to be updated to reflect latest helm chart version in airbyte artifacthub ? or am I get it wrong ? thanks

Hi there, I am trying to Incremental Append MSSQL to Google Cloud Pub/Sub that goes to a function for ETL Table I want to start incrementally syncing has 300+ million rows, it's my understanding that the first sync is a full refresh. Is it possible to avoid a full sync/refresh

Hey, I use BigQuery for destination and use

GCS Staging

as Loading Method, but I got this error :

The connection tests failed.
State code: NoSuchKey; Message: The specified key does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchKey; Request ID: null; S3 Extended Request ID: null; Proxy: null)

has anyone experienced this?

Hey, I deploy Airbyte on docker on my pc and i try to connect to sql server that also on my pc, i can reach the database with talend but i can't with airbyte, any help please ?

Hi really need insights on this.. I just updated my airbyte instance and my airbyte_db is gone... I have tried to recover the volume but it does not contains any data. I've lost ALL connections, sources and destinations. Any idea on what happened?

Hello! I came into Airbyte while looking for a Reverse ETL tool/service, and came into Grouparoo 🦘 but when checking their site it seems that Grouparoo Cloud is no longer being supported. I understand from this thread that eventually Airbyte will be in that space but I'm curious to know if there's an expected timeline for that. Cheers!

Hello Guys, I am trying to work on Python CDK and I am not able to open the heping interactive window, when I run /.generate.sh

Hi all - I am trying to get started using the CDK, but I am really struggling to get anywhere. While trying to follow the instructions, I am able to run`./generate.sh`. But next, the instructions say:

then follow the interactive prompt. Next, find all `TODO`s in the generated project directory -- they're accompanied by lots of comments explaining what you'll need to do in order to implement your connector. Upon completing all TODOs properly, you should have a functioning connector.

I didn't encounter any interactive prompt - it just says "Finished running generator" (see screenshot 🧵 ). And where is the "generated project directory"?