I changed the SYNC_JOB_MAX_ATTEMPTS to 1 (default it was 3) in the .env file. Still 3 attempts are being done when there is a failure. Do we need to do something to make changes done in the .env file to come into effect?

Hi forks， how to send data from airbyte source connector to sink connector? Is it sent directly or through m message queue or database for data caching?

HI I have migrated to 0.40.32 version and now have very many error messages in server logs when sync runs, although everything works fine. Have I missed some setting or is it just something with log level?

2023-02-06 07:57:06 ERROR i.a.c.s.h.JobHistoryHandler(listJobsFor):140 - Missing stats for job 10 attempt 0
2023-02-06 07:57:06 ERROR i.a.c.s.h.JobHistoryHandler(listJobsFor):140 - Missing stats for job 10 attempt 1
2023-02-06 07:57:06 ERROR i.a.c.s.h.JobHistoryHandler(listJobsFor):140 - Missing stats for job 6 attempt 0

Does anyone has built a Sybase connector ?

does anyone has dataset repository for practicing?

Got this CSV error. Tried changing the encoding on s3 source settings to

latin-1

or

iso-8859-1

and still the same issue. Any help please?

Hello everyone, my team and I are planning to host airbyte on GCP (Cloud Compute for now, we don't have big use cases for k8s). Any tips or recommendation for making it production-ready? Thanks :)

Hello Folks! I’m running Airbyte with Kubernetes, it’s great! However, I’m facing a problem when exporting a specific table to parquet, I receive the following error message:

Array contains a null element at 0

I saw the warning about turning the

parquet.avro.write-old-list-structure=false

. Is it possible to play with this flag running Airbyte via Kubernetes?

Hi team, will there be any date for Azure Blob storage connector availability?

Hello. Our Zendesk Support jobs take around 1 hour to complete even though I configured the streams as incremental and the size of our data is relatively small (around 3 million tickets). I wonder if anyone else has the same problem.

Hey folks, I'm trying to use the AppsFlyer source connector but it is giving me a strange error

"1 validation error for AirbyteRecordMessage\ndata -> __key__\n  none is not an allowed value (type=type_error.none.not_allowed)

I have no idea what this means

Hi - How the schema changes for big volume of table is being handled in CDC process using air byte ? doing Full Refresh would be costlier operations because of big volume of data. Is there a way we can do schema changes in destination using 'incremental append' synch mode.

Hi! We're experiencing some syncing issues with

source-postgres==1.0.39.

We're syncing incrementally on an

updated_at

column that can contain null values and consistently see newly created records with

updated_at==NULL

being skipped. This may be the expected behavior? Is there anything we can do to get around that and sync new data without losing the ability to get updated versions of records? Thanks in advance for your help 🙏

Hey guys, just wanted to flag the official Airbyte Changelog (shows up when googling Airbyte changelog) is out of date by over a year. Might be more helpful to remove or redirect to Github?

Hey friends. I'm having trouble connecting to salesforce. After selecting the table to be replicated, the connection set up fail with the error: non-json response. And it seems to be a too big http request (there are a a lot of tables to be replicated) can you provide assistance with that?

Hi there, I am hoping to get a small improvement to the Stripe Source connector landed - I went to make a PR for it myself but discovered that someone else had already made the improvement!! Their (very small) PR is still waiting for review / merge: https://github.com/airbytehq/airbyte/pull/19906

Hi folks, could you add your suggestions here for my current issue thread

The guidance on Google Analytics GA4 custom reports is here: https://docs.airbyte.com/integrations/sources/google-analytics-v4/#custom-reports And this page shows the JSON which replicates the built-in reports as custom reports (if you rename them): https://github.com/airbytehq/airbyte/blob/e63544b027e5721dda5188a53b79ab4e25006df5[…]/source_google_analytics_data_api/defaults/default_reports.json Can it be inferred that, unlike custom reports in the GA3 (Universal Analytics) connector, dimensions & metrics should not have the string

ga:

prepended to them in GA4? In other words: BAD

"dimensions": [
   "ga:date",
   "ga:city",
   "ga:browser",
   "ga:campaignName"
]

GOOD

"dimensions": [
   "date",
   "city",
   "browser",
   "campaignName"
]

This appears to be across the board for GA4 (see: https://developers.google.com/analytics/devguides/migration/api/reporting-ua-to-ga4-dims-mets) but the documentation for Airbyte still references

ga:

prefixes in some places.

hi, can anyone help understanding why connection states are not persisted in my k8s environment? is there a way to add debug logs? syncs are completed successfully but database not updated with state. I’ve tried with stripe and shopify connectors, whats the best way to solve this kind of issue? • airbyte version 0.40.32 (upgraded from 0.40.27, it happened there as well)

hello,is this the appropariate place to seek help ?

how could I debug this:

ERROR i.m.r.Micronaut(handleStartupException):338 - Error starting Micronaut server: Error instantiating bean of type  [io.airbyte.persistence.job.factory.OAuthConfigSupplier]

?

I am just doing

kubectl port-forward svc/airbyte-webapp-svc 8000:80

like it says in https://docs.airbyte.com/deploying-airbyte/on-kubernetes/

hello, Im trying to work on very standard connection source postgres 13 running on GCP destination is snowflake it is not the first connection I’m using between postgres and snowflake the only difference is different GCP project ’m getting the following error

Cannot invoke "java.sql.Array.getArray()" because the return value of "java.sql.ResultSet.getArray(String)" is null

any suggestions where should I look ?

Guys I need a little help with the SKeys and Account ID of Stripe source. I can't pull any data because of the error which says, the account needs to be a connect account Anyone please help? Please feel free to dm me

Hi airbyte team Could you help me on this ? I’m struggling for upgrading airbyte from 0.40.27 to. 0.40.28 in our helm charts

Hey developers, I'd love to get help to fix this and merge it: https://github.com/airbytehq/airbyte/pull/22475 I've created PR but it fails in one CI step

Need help in Mixpanel connector: I am getting data from mixpanel, for some reason when I select a date older than 4 days, I see no data. Sync results have 0 records emitted. But my mixpanel source has the data for the past 1 year. Is there any setting that is making airbyte not to consume data older than 4 days? Could some one who already worked with mixpanel give your inputs?

hi Aribyte Team , we have built custom connector image and placed it in ECR , however when we try to configure in UI we are getting "Internal Server erorr Get Spec job failed" we have built image on both platform amd and arm based. can you please help in resolving the same .

Hi guys, i connected the STRIPE connector successfully to SNOWFLAKE weeks ago, but on another instance a new connection is not possible (Unknown Error), are there any logs during connection creation and where do i find them (docker-compose setup & v0.40.32)

Hello everybody! Here is my problem. I deployed airbyte locally and am still finding my ways around adjusting the

docker-compose.yaml

file to my needs. I need to create a Postgres source from a the postgres running on the host machine, same one deploying airbyte. I tried using

host.docker.internal

and also adding it to the

extra_hosts

of the

worker

service, but it's not working. I just get this error message, and can't seem to get much else from the logs, any ideas?