Say anyone using restack to deploy? I just signed up and it doesnt show airbyte as an available application

Hi- I am not able to find the confluence connector on the UI. There's a prior resolved ticket for this- https://github.com/airbytehq/airbyte/issues/9171

Hi there! I am trying to setup a connection between MongoDB Atlas and ElasticSearch, but no matter what I try, I am getting the following errors in the Airbyte log:

error type: mapper_parsing_exception
 reason: failed to parse field [_id] of type [_id] in document with id '015dd0d8-9f33-4ab1-966a-148163d35144'. Preview of field's value: 'zaLEs1gr6t'
	at io.airbyte.integrations.destination.elasticsearch.ElasticsearchAirbyteMessageConsumerFactory.lambda$recordWriterFunction

It occurs even in the simplest cases where only a few fields are present in the source documents.

Hi I submitted my first PR and am awaiting approval. Can anyone tell me if I've done all the steps I need to do? https://github.com/airbytehq/airbyte/pull/23948

I just deployed Airbyte on EKS via Plural. Works perfect. Now salesforce.. How do I get the connector thats in cloud in the OSS version? My company forces SSO. They have shut down token/user/pass access. How can this be added to the OSS version?

Anyone have Credentials to pull data from Microsoft 365 Business Central? It would be very helpful, Only need it for two - three days for testing out API streams

Which connector is the appropriate to use for Microsoft Dynamics 365? It isn't backed by an MSSQL database that is accessible.

Hi all is it possible to use ad stream in bingads source connector in incremental mode?

Trying to follow the instructions to try AirByte in EKS doing the following:

eksctl create cluster
helm repo add airbyte <https://airbytehq.github.io/helm-charts>
helm repo update
helm search repo airbyte

========
NAME                            	CHART VERSION	APP VERSION  	DESCRIPTION                                       
airbyte/airbyte                 	0.45.0       	0.41.0       	Helm chart to deploy airbyte                      
airbyte/airbyte-bootloader      	0.45.0       	0.41.0       	Helm chart to deploy airbyte-bootloader           
airbyte/airbyte-cron            	0.40.37      	0.40.17      	Helm chart to deploy airbyte-cron                 
airbyte/connector-builder-server	0.45.0       	0.41.0       	Helm chart to deploy airbyte-connector-builder-...
airbyte/cron                    	0.45.0       	0.41.0       	Helm chart to deploy airbyte-cron                 
airbyte/metrics                 	0.45.0       	0.40.3       	Helm chart to deploy airbyte-metrics              
airbyte/pod-sweeper             	0.45.0       	0.39.37-alpha	Helm chart to deploy airbyte-pod-sweeper          
airbyte/server                  	0.45.0       	0.41.0       	Helm chart to deploy airbyte-server               
airbyte/temporal                	0.45.0       	0.41.0       	Helm chart to deploy airbyte-temporal             
airbyte/webapp                  	0.45.0       	0.41.0       	Helm chart to deploy airbyte-webapp               
airbyte/worker                  	0.45.0       	0.41.0       	Helm chart to deploy airbyte-worker       
=======

helm install 0.45.0 airbyte/airbyte

once that returns I get:

kubectl get pods 

NAME                        READY   STATUS    RESTARTS   AGE
0.45.0-airbyte-bootloader   0/1     Error     0          19m
airbyte-db-0                0/1     Pending   0          19m
airbyte-minio-0             0/1     Pending   0          19m

Hi team, Hosted airbyte in K8s and migrating data from mysql to bigquery I have made a change in the schema of bigquery but when the scheduled sync occurs the schema is again overwritten by airbyte how to avoid the schema in BQ being changed

Hello Everyone, I’m having a problem when trying with the OAuth flow for source in the Airbyte API. The first endpoint that is meant to set params in the sourceDefinition returns 200 (everything is fine) and then the second step of the oauth flow which is to get the consentUrl returns an error:

{
	"message": "Internal Server Error: Undefined parameter 'client_id' necessary for the OAuth Flow.",
	"exceptionClassName": "java.lang.IllegalArgumentException",
}

Hey everyone, I have just updated to 0.42.0 and Airbyte seems to be running really slow - things aren’t syncing, and my entire instance keeps freezing and needing to be rebooted. Just wondering if anyone else is having similar issues or any suggestions? I’m on an EC2 t2.large with 100GB of EBS storage. Most of the syncs I run are small jobs from S3 to Redshift.

Hey all, So I searched here and online for an answer to these questions so I apologize if they have been answered a bunch elsewhere and I missed it. 1. How do I deploy custom connectors? Specifically in a "Docker"/Ubuntu environment (Azure tutorial). Is there a document somewhere that walks you through this? Or is the preferred way to use a "local environment" setup and deploy your fork of Airbyte? 2. Is the .NET Connector Dev SDK still valid? It's referenced in the Airbyte docs but the GitHub project hasn't been updated in 2 years and when you use the cli to start a new connector the options are Python and Java, not .NET. If it is still valid, how do you actually use it within Airbyte? The README doesn't actually specify this. Our plan is to write most connectors in Python (duh) but we do have some legacy ETL .NET code that would be nice to port over as a stop gap and rewrite them in Python when we have more time. Thanks!

Hi team, I have a urgent requirement when i migrate data from mysql to Bigquery json field formats are typecasting to String how can i solve this issue Can i solve this by Using cdk, now i am using airbyte which is hosted in K8s

What happened to schema change feature? Which was supposed to come out in Jan/feb.

Hi guys, what is the correct way to add an output field with the new version of airbyte? Adding something very basic like a string, I always get the following error:

"Could not perform read with with error: Every message grouping should have at least one request and response"

Custom dbt transformations - how can I set a variable so I can use it like this in my dbt configuration "{{ env_var('DBT_ENV_SECRET_DB_PASSWORD') }}"?

For some reason, when selecting any of my google sheets sources I get the following error:

Internal Server Error: SQL [select * from "public"."actor_definition" left outer join "public"."actor_definition_workspace_grant" on ("public"."actor_definition"."id" = "public"."actor_definition_workspace_grant"."actor_definition_id" and "public"."actor_definition_workspace_grant"."workspace_id" = cast(? as uuid)) where ("public"."actor_definition"."id" = cast(? as uuid) and ("public"."actor_definition"."public" = ? or "public"."actor_definition_workspace_grant"."workspace_id" = cast(? as uuid)))]; Error while reading field: "public"."actor_definition_workspace_grant"."workspace_id", at JDBC index: 23

Any idea what can be the cause of this, all other type of connectors are working fine. EDIT: I tried different versions of google sheets, also when making new sources of type google sheets the same error occurs. With other type of sources or connections there are no problems. UPDATE: After upgrading to Airbyte 41.0.0 the problems resolved.

Another question (helm deployment to k8s on GCP), is it save to delete the

temporal

and

temporal_visibility

databases if you have a problem when upgrading with the schema versions? Will the deployment recreate them? UPDATE: I can confirm that the temporal container will automatically re-create both databases.

Hi there! About Scaling instances for airbyte worloads I have airbyte deployed on k8s. I have a seperate node group for airbyte related workload. What do you suggest, how to scale the airbyte nodes, either vertically or horizontally? ( quick recommendation/suggestion is required on this).

Hi, is there a process to get a PR reviewed? https://github.com/airbytehq/airbyte/pull/23548 and https://github.com/airbytehq/airbyte/pull/19797?

when running below command the path is not is not present showing kubectl apply -k kube/overlays/stable

git clone https://github.com/airbytehq/airbyte.git run this to install

Hey guys, I failed to establish the connection between Hubspot in Airbyte. Any hints? I'm connecting via private apps. Tried with several apps, but no luck. I'm using open-source deployment.

"HubspotInvalidAuth('The API key used to make this call is expired. View or manage your API key here: <https://app-eu1.hubspot.com/l/api-key/>')"

Hi All, I have successfully created sources and destination in my Airbyte instakce using Octavia CLI but while generating connection configuration.yml file getting error. " raise ApiAttributeError( airbyte_api_client.exceptions.ApiAttributeError: AirbyteStreamConfiguration has no attribute 'suggested' at ['received_data']['catalog']['streams'][0]['config']['suggested']"

Hi, can someone please help me understanding the source_oauth flow in Airbyte config API? I did the process for Google Ads and everything was fine but when using Facebook Marketing source I can’t get the consent URL. It seems I can’t set the OAuth variables in the source definition, was it because I already used the image before setting the variables? Heeeelp

Hey 👋 I have a problem with the Zendesk Chat connector: I can set it up but when I want to create a connection, It takes for ages and then I get a strange error

non-json response

. I use multiple connectors but Zendesk Chat is the only one I have this issue with

Hi all. as I´m struggling to understand which credentials I need to give Facebook for my App to be approved, I thought to deploy my local airbyte instance only with the Facebook marketing connection, through NGROK. But it returned me a 401 unauthorized. Anyone tried it in the past? or someone that got his Facebook app approved that can answer me which credentials I should give?

Hi, I am new to Airbyte and trying to build a custom connector to bitbucket and using the connector-builder. 1. The path/endpoint I am trying to reach has a front slash at the end (ss) 2. But the request that the connector builder just removes the trailing front slash (ss) 3. Because of which the response is 404 API end point not found Could someone kindly guide me in the correct direction or has anyone had this issue in the past?

Hi everybody I am new to using Airbyte and we upgraded to version

0.42.0

and airtable to

2.0.3

then we are unable to sync airbyte connection and getting the following error even after downgrading airtable to

2.0.1

2023-03-13 14:28:54 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-03-13 14:28:54 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-airtable:2.0.1 exists...
2023-03-13 14:28:54 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-airtable:2.0.1 was found locally.
2023-03-13 14:28:54 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = source-airtable-check-800-0-runao with resources io.airbyte.config.ResourceRequirements@87011e4[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts null
2023-03-13 14:28:54 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/800/0 --log-driver none --name source-airtable-check-800-0-runao --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e STRICT_COMPARISON_NORMALIZATION_WORKSPACES= -e WORKER_CONNECTOR_IMAGE=airbyte/source-airtable:2.0.1 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e STRICT_COMPARISON_NORMALIZATION_TAG=strict_comparison2 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.0 -e WORKER_JOB_ID=800 airbyte/source-airtable:2.0.1 check --config source_config.json
2023-03-13 14:28:54 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):107 - Reading messages from protocol version 0.2.0
2023-03-13 14:29:00 ERROR i.a.w.i.DefaultAirbyteStreamFactory(internalLog):164 - {"error":{"type":"NOT_FOUND"}}
2023-03-13 14:29:00 ERROR i.a.w.i.DefaultAirbyteStreamFactory(internalLog):164 - Check failed
2023-03-13 14:29:01 INFO i.a.w.g.DefaultCheckConnectionWorker(run):120 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@11543499[status=failed,message='404 Client Error: Not Found for url: <https://api.airtable.com/v0/meta/bases>']
2023-03-13 14:29:01 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling...
2023-03-13 14:29:01 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-03-13 14:29:01 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK -----
2023-03-13 14:29:01 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-03-13 14:29:03 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. 
errors: $.access_token: is missing but it is required, $.refresh_token: is missing but it is required
2023-03-13 14:29:03 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. 
errors: $.private_key: is missing but it is required
2023-03-13 14:29:03 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. 
errors: $.method: does not have a value in the enumeration [Standard]
2023-03-13 14:29:03 INFO i.a.c.f.EnvVariableFeatureFlags(autoDisablesFailingConnections):33 - Auto Disable Failing Connections: false