Hey guys! I would like to know if, for the hubspot source, it's possible to send values of the properties of streams such as Deals, Companies and Contacts with the history of values. Currently, these streams only bring in the current property values. If not, do you know if there is a pull request on this topic?

Hey Airbyte - question about metrics. I'm wondering if Airbyte OSS can be configured to emit metrics about sync job duration on a per-job basis? I've got our Airbyte instance hooked up to Datadog, and I've been looking at OssMetricsRegistry.java - the closest thing I see to that is probably

overall_job_runtime_in_last_hour_by_terminal_state_secs

, but what I was hoping is track execution time at the job level. Anything I'm missing?

Hi Team, does anyone know how to solve this issue? https://airbytehq.slack.com/archives/C021JANJ6TY/p1669154392351759

Is there connection from REST API in Airbyte? Because I need get the API https://covid-19.dataflowkit.com/v1 and POST in AWS S3 but I can’t see connection from REST API

Hi Team, is there a way to change custom connector’s logo from Airbyte’s default logo to a custom one?

Hi Team, The airbyte api page is showing

Error loading the spec
Unable to load the Spec

Hi Team, Is there anyway that I can do the dbt transformation before running the airbyte sync?

Hello Team, I have opened this PR on Airbyte for Source Amplitude to resolve issue #19605 to enable data server region selection. Can someone review it ? Thanks

Hi guys, So I have deployed and hosted deafult airbyte instance on GKE using helm install. but now I wish to add my custom connector docker image hosted on Artifact registry to that cluster. How do I go about doing this?

Hello, I hope this is a proper channel for asking this question. (1) We are currently thinking about getting rid of our own installation of Airbyte and moving to the Airbyte cloud. As we are based in Germany, I guess we would need to use the Europe Version of Airbyte Cloud. Is it already possible to just register via the normal signup flow or do we need to wait for early access? (2) The other question would be if using custom connectors, via docker containers is possible with the cloud version of Airbyte. So for using connectors that are not yet part of the official Airbyte distribution. Thanks a lot for your help!

trying to create a source on airbyte and I get this error

Caused by: io.airbyte.workers.exception.WorkerException: Could not find image: airbyte/source-mongodb-v2:0.1.19

Hi all, i deploy a airbyte on EKS by helm install with very minor changes in values.yalm. However, components failed to start. It seems components cant get the ENV or configmap airbyte-env.

webapp: nginx: [emerg] host not found in upstream "$INTERNAL_API_HOST" in /etc/nginx/conf.d/default.conf:2

server: java.lang.IllegalArgumentException: Env variable not defined: WORKSPACE_ROOT

cron : Message: Could not resolve placeholder ${DATABASE_PASSWORD}

Hi, We use Airbyte API to create connections. When needed we have to refresh schema (source table fields change for example) so we try to update connection or delete it and recreate it again. In both cases we get an error that it is "not allowed". For deleting a connection API call is very simple - just a connection ID is needed. But on the other hand I deleted the workspace by accident with no restriction. Probably there is some setting missing but we can not find it.

Hey! I had a problem at the end of installing airbyte in a VM in gcp. By typing the command line which is on the official website gcloud --project=$PROJECT_ID beta compute SSH $INSTANCE_NAME -- -L 8000localhost8000 -N -f The result was an arguments error like this (gcloud.compute.ssh) unrecognized arguments:

Hi Team, While creating a connection, we need to pass a custom string parameter "query" inside syncCatalog object. Which will be used in postgres source connector to perform some operation as per our needs. I have added that property in airbyte_protocol.yaml AirbyteCatalog and ConfiguredAirbyteProtocol also made changes in catalogConverter.java. After building the postgress connector and starting the server once I pass this string parameter to create connection api it is throwing me an error (Attached screenshot). Can someone help me how can I pass a string parameter create connection api and is there any place I need to make changes?

hello team - i'm trying to setup Mailersend connector in my open source installation and I'm facing the following issue. can someone please look into this?

Hello Team, We have Airbyte with the source as MSSQL and Bigquery as the Destination for 35 connections. So cron is required for our use case. We now have airbyte 0.40.4, which is not supported by cron. So we used git pull to upgrade to the most recent version (0.40.22). All of the connections have been restored following the upgrade. These connections are worked well on previous version. But now, while Trigger the sync, it throws error like, Failure Origin: source, Message: Checking source connection failed - please review this connection's config. In addition, I was unable to establish a source connection with the SQL server. also, editing of existing source MSSQL source connection also throws an error. Can someone please help me in this?

Hi, any contributors to the Bing ads source connector?? I need desperately the keyword field of the keyword_performance_report_daily. Can someone help me with that and add this column?? https://learn.microsoft.com/en-us/advertising/reporting-service/keywordperformancereportcolumn?view=bingads-13

Hi Everyone .. I'm new to Airbyte.. our requirement is to ingest data from snowflake table to csv file format to a sftp server .. I see sftp json connector but we need sftp csv

Hi everyone, I was trying to setup a connection between

Excel file

with multiple sheets and

postgres

. Since

source-file

connector accepts

Reader Options

where we can pass pandas

read_excel

arguments, i tried passing the list of sheet names as

{"sheet_name": ["sheet1", "sheet2"]}

. And, getting this error

AttributeError("'dict' object has no attribute 'columns'") Traceback (most recent call last): File "/airbyte/integration_code/source_file/source.py", line 112, in check list(client.streams) File "/airbyte/integration_code/source_file/client.py", line 416, in streams "properties": self._stream_properties(fp), File "/airbyte/integration_code/source_file/client.py", line 399, in _stream_properties for col in df.columns: AttributeError: 'dict' object has no attribute 'columns'

I'm using airbyte

v 0.40.21

Is there an option to create multiple users on Airbyte UI? in the open source version

Hi, I'm struggling to fully understand "Cursor field" when doing incremental loading in the context of campaignAnalytics for LinkedIn. In the case of the Screenshot. How is the end_date set? Is that always the day when the connector last ran?

Hi All, My need is to pass a custom string parameter "query" inside syncCatalog object while to create connection api (Screenshot attached) between source postgres and destination s3. So that I can get this value inside postgres source connector inside AirbyteCatalog object. I have added that property in airbyte_protocol.yaml and config.yaml along with changes in required classes. I have below questions for the same.Can someone help me on this. 1. Do I need to build entire airbyte platform? While build entire platfrom I getting error in airbyte-webapp test module. is there be any impact on webapp due to airbyte_protocol.yaml or config.yaml. How can I approach this problem. 2. While building only source postgres connector I am getting error saying unrecognized field "query". Where else I need to make changes so that this field can be recognized.

Hello y'all, I have an interesting situation when building a custom connector. It is using OAuth with a refresh token. Every time the refresh token is used, it issues me a new refresh token. Since this variable is currently stored within the Source config, I'm wondering if there was a way to update the config information for a source? Even if you can point me to an existing source that does something similar, I can take it from there. Thanks!

Hi guys, I’m having problem with Salesforce source, the error is bad request for url https://test.salesforce.com/services/oauth2/token

Has anyone gotten

Aurora MySQL (5.7.0) 2.10.2

to work with CDC? Incremental syncs are not picking up new records

Hello Team, I setup Airbyte on AWS EKS using Kustomization. And now I am setting s3 as destination and get this error on webapp "Internal Server Error: The Access Key Id you provided does not exist in our records. (Service: S3, Status Code: 403, Request ID: 172.......)" I tried with/without AWS credentials but I get the same error. Any way to fix/troubleshoot it?

Hi everyone, we've set up airbyte in an EC2 instance by following the instructions on this webpage: https://airbytehq.github.io/deploying-airbyte/on-aws-ec2. I don't have much experience working with docker. Currently, I am getting an error trying to set up a connection between Salesforce and Snowflake. The error ist "413 Request Entity Too Large" and is related to nginx/1.23.2. I have also seen that this isn't the first time that this comes up. I would appreciate if someone could help me out with some specifics: 1. Where is the Nginx config file in an EC2 instance that docker uses to build the airbyte-procy server? 2. How do I rebuild the docker image to use the updated configurations? Any support would be great. Thank you. Here's the structure of the directory where airbyte is └── airbyte ├── docker_boot.service ├── docker-compose.yaml └── temporal └── dynamicconfig

hi Guys, I wanted to know if we can set the replication frequency using cron to run every minute ? since when I input

* * * * *

it says invalid cron expression • We are using airbyte open source deployment • Source :- Mysql Database • Target :- Mysql DB RDS