Hi Team, Is there any plans of editing this connection state last_run_timestamp in the UI self instead of updating in the postgres db? This small feature helps to backdate and run the pipeline to capture the missing records.

Hello Everyone, Looking for documentation or example on Github sharing details on Data Replication using Airbyte CLI and Python CDK.

Hi all, I have S3 source with JSon files. I have problem that i want receive data like

"jsonpaths": [
        "$.actionTemplate.ids.systemName",
        "$.actionTemplate.name",
        "$.brand.ids.systemName",
        "$.channel.ids.externalId",
...

When I try use it at field ‘Manually enforced data schema’ like {“$.actionTemplate.ids.systemName”: “string”} it doesn’t work. My question is: how i can determine jsonpath for S3 source connector ?

Hi all, We're looking at using airbyte for ingesting data from a variety of sources into databricks. Currently our databricks solution is setup with GCP, does airbyte support this or is it only via AWS/S3 and Azure?

Hello everyone, I created a custom connector for Redshift. I want to normalize the resultant data using dbt models. But, the Airbyte UI tells that “Normalization and Transformation operations are not supported for this connection.” Is there any way I can use dbt transformations along with the custom connector? Since it is possible before with the redshift connector provided by Airbyte, it shouldn’t be that different for the custom redshift connector that I created. Any help on this will be much appreciated.

Hey there, I am currently testing the Low-Code CDK and got an issue on the step 2 of the tutorial : https://docs.airbyte.com/connector-development/config-based/tutorial/install-dependencies

When I am trying to run the command :

python main.py spec

Anyone get the same issue?

hi all - question on the pricing for airbyte. The database credit fee - is that just when airbyte takes data from a database say on BigQuery rather than when it sends data there?

Any takers on this? Would really appreciate it.

Hi there, anyone in the community using AWS Aurora Postgres Serverless as the Airbyte Database and can share whether it works well (thinking of warm up after sleep)?

Hi all, when loading to Snowflake, is it possible to select a subset of the columns? I currently do not see this option. Perhaps we need to do a custom normalization?

Hey folks, I just spun up Airbyte on a DigitalOcean Droplet via the Marketplace.

I connected Slack as a Source and BigQuery as a Destination. Both tested as fine initally.

But the whole thing just stopped syncing after a while. I deleted the connection and now I'm trying to recreate it and it's just giving me an error.

Heres the logs from the aforementioned failure. Anyone able to point me in the right direction?

Hi all, I opened an issue and I want to contribute with a PR to fix it. I was following the contributing guide and it says I need to assign the issue to myself and I don't have this option. How can I proceed? Thanks!

How can I change the

url_base

inside the requester based on the geography specified by the client. Essentially, I want somethiong like the below

requester:
  type: HttpRequester
  url_base: "<https://api.exchangeratesapi>.{{ geo_mapping[config['account_username'].upper()] }}/v1/"
  http_method: "GET"
  request_options_provider:
    request_parameters:
      k1: v1
      k2: v2
    request_headers:
      header_key1: header_value1
      header_key2: header_value2
geo_mapping:
  'US':'com'
  'EU':'eu'

Is it possible to do something like above?

execution logs show 3mm records, but only 1mm in the raw table, any ideas?

hello all, i am facing an issue when connecting to airbyte after installing it into AWS EC2 i used this commands for installation process. • sudo yum update • sudo yum remove docker docker-client docker-client-latest docker-common docker-latest docker-latest-logrotate docker-logrotate docker-engine • sudo yum install -y yum-utils device-mapper-persistent-data lvm2 • sudo amazon-linux-extras install docker • sudo service docker start • docker run hello-world • sudo rm /usr/local/bin/docker-compose • sudo wget https://github.com/docker/compose/releases/download/v2.11.2/docker-compose-$(uname -s)-$(uname -m) -O /usr/local/bin/docker-compose • docker-compose --version • sudo chmod +x /usr/local/bin/docker-compose • docker-compose --version • mkdir airbyte && cd airbyte • wget https://raw.githubusercontent.com/airbytehq/airbyte-platform/main/{.env,flags.yml,docker-compose.yaml} • docker-compose up -d • SSH_KEY=~/Downloads/dataline-key-airbyte.pem • ssh -i $SSH_KEY -L 8000localhost8000 -N -f ec2-user@$INSTANCE_IP • Visit

<http://localhost:8000>

to verify the deployment. and i am getting this error. Please tell me how to solve this or i am doing anything wrong here.

Hello! 🦉 I am trying to set a Postgres integration with a replication slot, but I am getting a

io.airbyte.commons.exceptions.ConnectionErrorException: java.sql.SQLTransientConnectionException: HikariPool-1 - Connection is not available, request timed out after 10001ms.

error because the port is not open. I should authorize the airbyte IP addresses. Where can I get this information? Thanks a lot!

Hi everyone! We are hosting our weekly community office hour in just 25 minutes over at #C045VK5AF54! Come over and ask your questions, we're online every Wednesday at 11AM PST! octavia wave

Hi team, I'm facing an issue with the webapp, when I click in the "Create your first connection" button I'm seeing an error in the browser's console saying that:

MissingConfigError: Missing required configuration cloudApiUrl
    at Tn (useFreeConnectorProgram-2c5b2e2d.js:1:3163)
    at D (InlineEnrollmentCallout-6d3516c5.js:1:1199)
    at bo (index-01f874f4.js:37:52767)
    at wa (index-01f874f4.js:41:8607)
    at ya (index-01f874f4.js:41:932)
    at kc (index-01f874f4.js:41:863)
    at cn (index-01f874f4.js:41:722)
    at ho (index-01f874f4.js:39:10777)
    at index-01f874f4.js:37:38613
    at e.unstable_runWithPriority (index-01f874f4.js:26:3835)

and I'm seeing the attached page's image. Could someone please help me to take a look if I forgot to put something in the configuration? Note: I'm using K8s to deploy it, thanks

I think latest changes pushed to Airbyte makes my manifest.yaml of 0.1.0 version non functional!

Hello Airbyte team , today while trying to deploy to a new instance in EC2 following these instructions, we were enable to start the server , the logs showed that the server would be “ready soon” , but it never truly finished. ( this was on version 0.42) We tried deploying a previous version ; and while this one started , we got the following error messages when trying to test our first connection ( between Freshpaint and Bigquery) ( on version 0.41 )

trying to deploy in google cloud, following the docs step by step. The "install airbyte" step doesn't seem to work. when I run

curl -sOO <https://raw.githubusercontent.com/airbytehq/airbyte-platform/main/{.env,flags.yml,docker-compose.yaml}>

it prints a lot of output and finishes immediately. then

docker compose up -d

returns

no configuration file provided: not found

what did I do wrong?

I've been having a lot of issues loading the settings page lately - it seems that my airbyte installation is running into issues fetching definitions? (partial exception below) is there a solution to this? these pages take minutes to load, if they load at all

[airbyte-server-5757c879fd-w4ttv] java.lang.RuntimeException: Failed to fetch remote definitions
[airbyte-server-5757c879fd-w4ttv] 	at io.airbyte.config.init.RemoteDefinitionsProvider.getRemoteDefinitionCatalog(RemoteDefinitionsProvider.java:127) ~[io.airbyte.airbyte-config-init-0.42.0.jar:?]
[airbyte-server-5757c879fd-w4ttv] 	at io.airbyte.config.init.RemoteDefinitionsProvider.getSourceDefinitionsMap(RemoteDefinitionsProvider.java:65) ~[io.airbyte.airbyte-config-init-0.42.0.jar:?]
[airbyte-server-5757c879fd-w4ttv] 	at io.airbyte.config.init.RemoteDefinitionsProvider.getSourceDefinitions(RemoteDefinitionsProvider.java:91) ~[io.airbyte.airbyte-config-init-0.42.0.jar:?]

Hello everyone! I wanted to ask for help setting up a Google ads source, I have been stuck for a week and have no idea what I'm doing wrong

Deploy using these instructions - https://docs.airbyte.com/deploying-airbyte/on-digitalocean-droplet/ Tried multiple times. Same result. Waited for a while as well. Is there a better instruction doc?

Hi,What is the problem and how to solve it