I want to Use Rest API as a source but there is no connector for that

How can I do that

Hello! which is the last updated version of the helm chart?

Seems like there's now like 4-5 tickets regarding this S3 staging where not all files are loaded...what's the right parent ticket to follow on this? https://github.com/airbytehq/airbyte/issues/10646 ? or is there a different one. Thanks!

if you switch to internal staging the issue isn't present

Hello! It is possible to add custom labels to a worker pod in k8s?

Hello everyone 🙂 Currently I'm trying to run airbyte inside GKE but I'm running into issues. Hopefully someone can help me out. I try running with GCS and external db but

webapp

and

server

deployments stay in invalid state. Inside the

server

logs I see that the pod crashes after following messages:

2022-03-17 16:42:12.889 CET2022-03-17 15:42:12 [32mINFO[m i.t.s.WorkflowServiceStubsImpl(<init>):188 - Created GRPC client for channel: ManagedChannelOrphanWrapper{delegate=ManagedChannelImpl{logId=9, target=airbyte-temporal:7233}}
2022-03-17 16:42:10.880 CET2022-03-17 15:42:10 [33mWARN[m i.a.w.t.TemporalUtils(getTemporalClientWhenConnected):185 - Waiting for default namespace to be initialized in temporal...

For additional context. I have 3 source tables with a shared join key. After every Airbyte replication job, at least one of the three relationship tests on that join key fails, because one of the table is always missing records that the other two are not (by a few seconds) at the time of replication.

Hello, does airbyte store a connection pods resources in db ? I get, time to time, resources set in the main container of my job pods that doesn't match the job resources env vars (JOB_POD_MAIN_... and JOB_MAIN_...). The resources doesn't match the limitranges object in my airbyte namespace.

Hello. We’re using Google Analytics v4 (GA4). I’m not able to sync GA data to our warehouse using the Airbyte GA connector because it is requiring a “view_id” in the source setup (view_ids no longer exist as a concept in GA4). Just wanted to check/confirm if there was any workaround for setting up a connector, or whether this the GA connector is known to not be working for GA4 properties.

Hi @Erica Struthers @Erica Struthers (Airbyte) @Ari Bajo for Facebook with Airbyte Cloud we are facing some errors. Here is the screenshot, please help with this:

Hi folks. We’re evaluating Airbyte Cloud. We’re running in GCP. I followed the steps to set up a Google Cloud PubSub destination. However, when I attempt to create the destination, I get

getTransportChannel() called when needsExecutor() is true

error with no logs. This seems to happen very early in the destination provisioning since I receive the same error even after using an invalid private key, invalid topic, or invalid project. Anyone seen this before or have insights?

I limited the stream to only one and only last several months and still getting errors, seems that the job get cancelled.

Is this your first time deploying Airbyte: No
OS Version / Instance: EC2 t2.large (problem seems to exist on a local instance as well)
Deployment: Docker
Airbyte Version: 0.35.57-alpha
Source:  n/a
Destination: n/a

hi all - my question is on the configuration (

archive.gz

) import. We're designing a disaster recovery process for saving connector configurations and we're able to grab the export tarball no problem (programmatically, using the endpoint or manually in Settings > Export Configuration) but unable to consistently import the

archive.gz

into a given instance. If I drag and drop my

archive.gz

via the UI, it seems to accept it but then does nothing (i.e. fresh instance remains empty) and then I followed along with these docs to try and use the import endpoint instead but that didn't respect the contents of the

archive.gz

either other things that might be relevant: • original problem detected on AWS EC2 but then reproduced on a local docker deployment • the airbyte instance version (0.35.57-alpha) was consistent across export and import attempts any help is greatly appreciated (tagging @Josh Liu for visibility)

Hey, I just installed airbyte on EC2. I created a source and destination and connection tests were successful. However, when I try to create a connection, I get "Unknown Error" on the screen when it is trying to fetch the schema. Any ideas on what might be going on or how to troubleshoot? Version: 0.35.55-alpha Source: Postgres 0.4.9 Destination: S3 0.2.10

Hi, i have a little issue about alerting, i already setup webhook slack url in Airbyte setting but when some tasks failed it won't send any message to my slack channel I use Airbyte 0.32.2-alpha

Hi, I am trying to setup source connector "Zendesk Sunshine" using API Token but it runs into an error regarding "ssl handshake failure". I couldn't find any helping material on this. Would be great if you guys can assist me on this! Please find the attached error message.

Hi.. I´m having trouble connect airbyte to an Mongo at AWS

`Is this your first time deploying Airbyte`: yes `OS Version / Instance`: Windows `Deployment`: Docker Issue: First time trying to deploy Airbyte on my local machine using Docker. Followed the 3 step instructions (git-clone, cd, docker-compose up) and am getting the following error. Any ideas? docker-compose up time="2022-03-18T091212-04:00" level=warning msg="The \"RUN_DATABASE_MIGRATION_ON_STARTUP\" variable is not set. Defaulting to a blank string." time="2022-03-18T091212-04:00" level=warning msg="The \"SECRET_PERSISTENCE\" variable is not set. Defaulting to a blank string." time="2022-03-18T091212-04:00" level=warning msg="The \"WORKER_ENVIRONMENT\" variable is not set. Defaulting to a blank string." time="2022-03-18T091212-04:00" level=warning msg="The \"SECRET_PERSISTENCE\" variable is not set. Defaulting to a blank string." time="2022-03-18T091212-04:00" level=warning msg="The \"WORKER_ENVIRONMENT\" variable is not set. Defaulting to a blank string." time="2022-03-18T091212-04:00" level=warning msg="The \"SECRET_PERSISTENCE\" variable is not set. Defaulting to a blank string." time="2022-03-18T091212-04:00" level=warning msg="The \"WORKER_ENVIRONMENT\" variable is not set. Defaulting to a blank string." [+] Running 0/8 - worker Error 3.1s - bootloader Error 3.1s - server Error 3.1s - db Error 3.1s - scheduler Error 3.1s - airbyte-temporal Error 3.1s - init Error 3.1s - webapp Error 3.1s Error response from daemon: manifest for airbyte/webapp:22.0 not found: manifest unknown: manifest unknown

Back on this one : when using custom destination images, it seems that we are then unable to use a normalization image due to this static mapping. Could it be possible, when adding a new custom destination, to have the ability to add a normalization image?

Hi,

Hi, I’m trying to setup a destination via big query, but I keep receiving this message. Any help would be appreciated, thank you. com.google.gson.stream.MalformedJsonException: Use JsonReader.setLenient(true) to accept malformed JSON at line 1 column 1 path $

Is this your first time deploying Airbyte: Yes OS Version / Instance: Windows 10 Pro – Local install Deployment: Docker Airbyte Version: 0.35.42-alpha Source: Postgres 0.4.4 on AWS no SSH Destination: MS SQL Server 0.1.15 Destination: I can only sync one table at a time by setting up a connection for each table. The sync always fails when multiple tables are selected. I get this error but cannot find how to resolve. DefaultReplicationWorker(run):168 - Sync worker failed.

Is this your first time deploying Airbyte: Yes OS Version / Instance: Mac OS 11.6.4 Memory / Disk: 32Gb / 500Gb Flash Storage Deployment: Docker Airbyte Version: 0.35.53-alpha Source name/version: Postgres 12.8 on GCP Cloud SQL Destination name/version: BigQuery Step: Setting new connection, source / On sync Description: I am evaluating Airbyte. I have setup a new connection successfully but it does not retrieve any streams (~tables) for me to select from the source. It does not give any error while setting up the connection. Running a sync does not sync any tables. I am trying to connect to Postgres source running on GCP Cloud SQL via a cloud proxy. If I connect to Postgres source running locally on my Mac it retrieves the schema (~tables) from the source fine for me to select via UI. Attached are logs and screenshot. Please help !!

loading...

But it's not working

Here are the logs

loading...

Please help, I am not able to figure out the issues here

Is this your first time deploying Airbyte: Yes OS Version / Instance: macOS Monterey 12.1 (M1) Memory / Disk: 16Gb / 1Tb SSD Deployment: Local (DOcker compose?) Airbyte Version: Unknown Step: Getting started Description: I’m trying to run AirByte by following the instructions and it’s failing on the first step:

alfie  documents/code/airbyte   master  export DOCKER_BUILD_PLATFORM=linux/arm64
export DOCKER_BUILD_ARCH=arm64
export ALPINE_IMAGE=arm64v8/alpine:3.14
export POSTGRES_IMAGE=arm64v8/postgres:13-alpine
export JDK_VERSION=17
 alfie  documents/code/airbyte   master  VERSION=dev docker-compose up
WARNING: The RUN_DATABASE_MIGRATION_ON_STARTUP variable is not set. Defaulting to a blank string.
WARNING: The SECRET_PERSISTENCE variable is not set. Defaulting to a blank string.
WARNING: The WORKER_ENVIRONMENT variable is not set. Defaulting to a blank string.
Creating network "airbyte_default" with the default driver
Creating volume "airbyte_workspace" with default driver
Creating volume "airbyte_data" with default driver
Creating volume "airbyte_db" with default driver
Pulling init (airbyte/init:dev)...
ERROR: manifest for airbyte/init:dev not found: manifest unknown: manifest unknown