Hello, where is the right place to advertise a need for new connector development?

im using airbyte to export data from postgres, mysql, etc. into an s3 bucket. it works well but takes a long time even when the datasets are relatively small. is there a way to speed this up? why does it take this long to sync up sources?

Hello, I am using Airbyte in the multi tenant environment where particular integration (i.e., JIRA) can come from different tenant accounts and my app should be able to show the synced data within the platform for specific tenant. Has anyone come across similar scenario and how did you solve it in Airbyte ?

I’ve got an issue with the salesforce connector. I posted to discourse, but i’m unable to continue participating in the discussion because my account is apparently too new. Salesforce Bulk Stream: Full Refresh | Overwrite - Troubleshooting - Airbyte Any suggestions? I’m trying to prove this out with self-hosted so I can make the case for the SaaS option, but this is a blocker.

Is anyone having trouble with Postgres+incremental models? Since the last upgrade to the Postgres connector, Airbyte has been consistently failing to complete a[n incremental] sync. Regardless of Source, Postgres gets hung up on

step 3 of 4 START incremental model

2022-06-17 15:14:51 normalization > 15:14:51

2022-06-17 15:14:52 normalization > 15:14:52  1 of 4 START view model _<http://airbyte_airbyte.my|airbyte_airbyte.my>_model_ab2........................................... [RUN]

2022-06-17 15:14:55 normalization > 15:14:55  1 of 4 OK created view model _<http://airbyte_airbyte.my|airbyte_airbyte.my>_model_ab2...................................... [CREATE VIEW in 2.84s]

2022-06-17 15:14:55 normalization > 15:14:55  2 of 4 START incremental model _<http://airbyte_airbyte.my|airbyte_airbyte.my>_model_ab2.................................... [RUN]

2022-06-17 15:15:24 normalization > 15:15:24  2 of 4 OK created incremental model _<http://airbyte_airbyte.my|airbyte_airbyte.my>_model_stg............................... [INSERT 0 1769 in 29.17s]

2022-06-17 15:15:24 normalization > 15:15:24  3 of 4 START incremental model <http://airbyte.my|airbyte.my>_model_scd............................................. [RUN]

The below query is the issue.

/*{"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.my_model_scd"} */

    alter table "my_db"."airbyte_schema"."my_model_scd" add column "my_col1__dbt_alter" text;
    update "my_db"."airbyte_schema"."my_model_scd" set "my_col1__dbt_alter" = "my_col1";
    alter table "my_db"."airbyte_schema"."my_model_scd" drop column "my_col1" cascade;
    alter table "my_db"."airbyte_schema"."my_model_scd" rename column "my_col1__dbt_alter" to "my_col1"

Error checking connection, status: Optional.empty, exit code: 1

getting this error while setting up gsheets as source.