Hey! I set up a Postgres -> Snowflake connection and I noticed it's creating 2 extra tables in the destination schema for every table in the source:

_airbyte_raw_<table_name>

and

<table_name>_scd

. Is there a way to tell Airbyte to write those tables in a separate schema or is there any systematic way to hide them other than manually tweaking the permissions? I'd rather keep the schema clean only with the main tables.

If i am developing a custom connector for internal use, how is the intended way to version control it. Should I check in the whole repository, or break out the connector to a separate?

I noticed the base normalization Docker container pulls from a deprecated DBT image. This image is running a Python version (python:3.9.9-slim-bullseye) that is throwing a ton of vulnerability errors. Is there a plan to build the normalization images using the DBT Labs GitHub Packages?

Not sure how to contact on-call support. But a change to Salesforce has introduced a bug https://github.com/airbytehq/airbyte/issues/20703#issuecomment-1427154287

Hi Airbyte Team, I tried to connect with Zendesk Support, but it keep showing this error:

ConnectionError(MaxRetryError("HTTPSConnectionPool(host='<http://setelappsupport.zendesk.com|setelappsupport.zendesk.com>', port=443): Max retries exceeded with url: /api/v2/account/settings.json (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f63cab4f3d0>: Failed to establish a new connection: [Errno -3] Try again'))"))

Hi Airbyte team, we get this from log:

2023-02-13 02:24:10 ERROR i.a.w.g.DefaultCheckConnectionWorker(run):124 - Unexpected error while checking connection: 
io.airbyte.workers.exception.WorkerException: null
	at io.airbyte.workers.process.KubeProcessFactory.create(KubeProcessFactory.java:143) ~[io.airbyte-airbyte-commons-worker-0.40.32.jar:?]
	at io.airbyte.workers.process.AirbyteIntegrationLauncher.check(AirbyteIntegrationLauncher.java:100) ~[io.airbyte-airbyte-commons-worker-0.40.32.jar:?]
	at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.40.32.jar:?]
	at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:41) ~[io.airbyte-airbyte-commons-worker-0.40.32.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.32.jar:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
Caused by: java.lang.InterruptedException
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1681) ~[?:?]
	at java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:515) ~[?:?]
	at java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:677) ~[?:?]
	at io.airbyte.workers.process.KubePortManagerSingleton.take(KubePortManagerSingleton.java:67) ~[io.airbyte-airbyte-commons-worker-0.40.32.jar:?]
	at io.airbyte.workers.process.KubeProcessFactory.create(KubeProcessFactory.java:101) ~[io.airbyte-airbyte-commons-worker-0.40.32.jar:?]
	... 5 more

any idea what this could be related?

hi team , would you like to help me review and merge this pr https://github.com/airbytehq/airbyte/pull/22855

Hi, no one with experience or advice for abnormaly long incremental load of small addition to large tables? https://airbytehq.slack.com/archives/C021JANJ6TY/p1675785150880499 Thanks!

Hey hello. Any news on when a new Airbyte version will be released? We'd like to setup a proof-of-concept on EC2 but the current

0.40.32

seems it's including a bug (according to release notes) 🙂 Thanks!

Hello, does anyone know where to set amazon STS session security token in Amazon Seller API connector? In the configuration screen, there are only fields for access key and access secret , but not for security token. I had browse the source code and the session token field is in the source code , but not the UI.

Hi Airbyte Team - is there any way to track connection creation and removal from log files? This is very urgent so please help asap. thanks

can i use bitbucket also for git in custom dbt form in airbyte?

My kingdom for the ability to resync/refresh a single table within a stream 🙏

Why Airbyte is not maintaining dedicated repos for source and destination connector?? Because of high quantity of issues and PRs it's must be harder for the community to maintain speed for Bug Improvements and features in connectors.

@Piyush Singariya - they are separating them Feb 20

Hello everyone! I'm trying to trigger the AirByte sync run with Airflow but having an error related to Airflow connection to Airbyte. Deployment parameters: • Google Cloud Platform • Airflow: Composer v 1.20.5 • Airbyte: Kubernetes cluster My questions are: 1. Which exact host/port do I need to specify for Airflow connection to Airbyte? The arbyte-server-svc one (please see screenshot attached)? 2. Do I need to set up more than a Firewall rule for the Airflow service account and Airbyte ip list? Haven't found any description in this guide

Does anyone manage to successfully connect to PostgreSQL RDS db? We are getting the following error:

2023-02-13 16:16:06 ERROR i.a.w.g.DefaultCheckConnectionWorker(run):124 - Unexpected error while checking connection: 
io.airbyte.workers.exception.WorkerException: Could not find image: airbyte/destination-postgres:0.3.26
	at io.airbyte.workers.process.DockerProcessFactory.create(DockerProcessFactory.java:103) ~[io.airbyte-airbyte-commons-worker-0.40.32.jar:?]
	at io.airbyte.workers.process.AirbyteIntegrationLauncher.check(AirbyteIntegrationLauncher.java:100) ~[io.airbyte-airbyte-commons-worker-0.40.32.jar:?]
	at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.40.32.jar:?]
	at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:41) ~[io.airbyte-airbyte-commons-worker-0.40.32.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.32.jar:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]

I am trying to setup Facebook Marketing source and after following the instructions and creating a token I receive this error.

FacebookAPIException('Error: 2635, (#2635) Your app has been upgraded to version v16.0, please use this version or newer. This can be verified in the settings tab on the App Dashboard.')

I cannot find any documentation about this issue and curious if anyone else has had it happen before?

Hi, am trying to connect Google Analytics(GA4). I am an admin and I can see GA_PROPERTY_ID in google analytics console but am getting following error when I try to connect."error": { "code": 403, "message": "User does not have sufficient permissions for this property. To learn more about Property ID, see https://developers.google.com/analytics/devguides/reporting/data/v1/property-id.", "status": "PERMISSION_DENIED" }

Hey folks, i’m having trouble getting past the initial sync of a postgres read replica to s3. the db we’re attempting to replicate is fairly large and very active. when we trigger the initial sync using the setup detailed here, the sync kicks off just fine but the cpu load on the master db creeps up to 100% over time. should i be taking a different approach other than setting

hot_standby_feedback

to

true

?

hi , i was trying to build a custom connector and got the below error when running the generate.sh . please help

Wondering if anyone can help me out here

Can someone suggest me how to debug error for my connector

Hello! I am running into an issue with exporting data from redshift to an s3 bucket with root level flattenting. the __airbyte_ad_id and _airbyte__emitted_at are included in the __airbyte__data. Any thoughts on how we can omit these tables? cc: @brad

Hey, Is it possible to create a source that pull all data without defining a start_date?

or is there any way to obtain the date for the earliest data available ?

Hi! When syncing data from MySQL to Redshift, it fails the sync for one table because of a

Invalid value for DayOfMonth

error. I checked the source table and there was one row with a Datetime value

0000-00-00 00:00:00

, which we manually manipulated that rows to represent a real date, but still, it's throwing the same error. Logs are in the comments.

hi! our Intercom-to-Snowflake sync job keeps failing with the same error code

Additional Failure Information: message='io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.', type='java.lang.RuntimeException', nonRetryable=false

airbyte v0.40.32, intercom source v0.1.30, created the connection on 2/10. this sync only tries to sync

conversation_parts

(syncing all other tables successfully in a separate connection after we isolated the issue). anything we can/should do to fix this?

Hi @Jerri Comeau (Airbyte), I noticed an issue in Instagram Source. I have reported it https://github.com/airbytehq/airbyte/issues/22929 I have also fixed it, https://github.com/airbytehq/airbyte/pull/22928. Please help me in getting this reviewed.