Hi @kapa.ai I'm developing a custom connection for the platform, and the result/output will be written as an Excel, XLSX, or CSV file. So, how will it be saved in the Airbyte? a screenshot of the official documentation is included below. Note: The outcome in Python can be saved in a file.

Hi @kapa.ai I'm developing a custom connection for the platform, and the result/output will be written as an Excel, XLSX, or CSV file. So, how will it be saved in the Airbyte? a screenshot of the official documentation is included below. Note: The outcome in Python can be saved in a file.

@kapa.ai I need to create a custom connector and need to add my jar file to the classpath of Airbyte, how can I do that ?

@kapa.ai can i make a custom api endpoint requester using python code in my low code cdk

How does Airbyte know which point the next incremental append to start in the next sync

Does the basic normalization work with databricks destination?

@kapa.ai I'm running the Google Ads connector (v. 3.7.0) and it only shows 4 weeks previous data on the stream name "account_performance_report". Is there something I can do so that I get all the history?

@kapa.ai I create a connector via Connector Builder - To get the token I need to send a post query on the format

x-www-form-urlencoded

how could I configure it ?

@kapa.ai I test APIs in Connector Builder but everytime the progress took more than 30 seconds, it always returned error "An unknown error has occurred". How to prevent this error?

@kapa.ai I would like to lock edit / write access on sources, destinations and connections in production Airbyte instance. How can I do that?

How can I rollback a version upgrade with breaking database migrations?

@kapa.ai I get the following error when im trying to test out my low code cdk soure connector jsonschema.exceptions.ValidationError: 'CustomPaginationStrategy' is not one of ['DefaultPaginator']

@kapa.ai i have Airbyte VERSION=0.63.13 deployed with docker, on Instance t3.2xlarge Can you help me to set this values to get the best performance? as i noticed it's becomes slow more than the old VERSION=0.50.30 JOB_MAIN_CONTAINER_CPU_REQUEST= JOB_MAIN_CONTAINER_CPU_LIMIT= JOB_MAIN_CONTAINER_MEMORY_REQUEST= JOB_MAIN_CONTAINER_MEMORY_LIMIT=

@kapa.ai how can i increase timeouts in the webapp

Hey AI! Am I able to get Google Ads events from Airbyte? Not only ‘installs’ for example, but custom events as well.

@kapa.ai does airbyte-ci needs internet to build connectors

I want to run Airbyte on EC2 and persist the app even when the instance is stopped and restarted. How do I select an installation directory when running abctl, so I can point it to a mounted EBS volume?

@kapa.ai I'm running airbyte version 0.63.12 via helm. I have a connector using source-instagram and writing into snowflake. I have a custom docker image created on july 31 2024 that works perfectly. When i recreate the docker image with the exact same code today, august 27 2024, the sync fails with out of memory errors. What could have changed between these images to cause out of memory errors

@kapa.ai In previous versions of Airbyte, there was an option to transform the data and leave it as

raw_data

in JSON format. I'm currently using version 0.63, but I can't find this option. How can I configure my data pipeline in this version to ensure the data remains in

raw_data

(JSON) format?

@kapa.ai hey, currently my team has created all connections, sources and destinations through the Airbyte UI. We are planning to scale a lot more and thus will need many more connections. What is the best programatic way to do this? I need to be able to easily create and manage connections, sources and destinations even possibly add new columns to existing ingestions. Is the best way via Terraform or another API? The only real options for this team include either Terraform or Python or some combination of both

@kapa.ai im getting

Caused by: java.lang.IllegalArgumentException: Unspecified schema type

after upgrading to the latest version how can i fix this?

@kapa.ai I upgraded my destination postgres to v2. I used to join my airbyte.uniprotkb and airbyte.uniprotkb_keywords tables on unitprotkb._airbyte_uniprotkb_hashid = uniprotkb_keywords._airbyte_uniprotkb_hashid. However the uniprotkb table no longer has a _airbyte_uniprotkb_hashid column. The only airbyte generated columns on uniprotkb are _airbyte_raw_id, _airbyte_extracted_at, _airbyte_generation_id and _airbyte_meta How can I join the tables?

@kapa.ai - Has anyone implemented a connector that accepts multiple sources? Something that could accept a list of stores (or their respective API credentials) as input, and then iterate over this list to establish connections to each store?

@kapa.ai I'm using Airbyte version 0.63.4, and I'm encountering an issue when trying to set up a cron job to run on a specific day of the week. The cron configuration results in an error. How can I resolve this issue to ensure the cron job runs only on the desired day?

@kapa.ai I'm trying to setup a new connection with an SFTP server as the source and either S3 or Redshift as the destination. When I'm setting up the connection, I get stuck on the "Select Streams screen". Even if I refresh the source schema the screen still doesn't show any streams, any ideas?

Saved offset is before replication slot's confirmed lsn. Please reset the connection, and then increase WAL retention and/or increase sync frequency to prevent this from happening in the future. See <https://docs.airbyte.com/integrations/sources/postgres/postgres-troubleshooting#under-cdc-incremental-mode-there-are-still-full-refresh-syncs> for more details.

I have this error when using cdc mode for postgres 12

@kapa.ai I don't see helm charts for versions past

0.61.0

in the repo. Do you know where I can find the helm charts for latest versions for this month?

@kapa.ai When building a connection with Microsoft SQL as a source I get a (HTTP 504) error. How would I resolve this error?

@kapa.ai I am looking for campaign report at device level from google ads data

I am looking for keyworld performance report at device level from google ads data