I see in GitHub issues there is "bounty" and "reward-100". What is that? Here is an example: https://github.com/airbytehq/airbyte/issues/20703

Is using HTTPStream still the way to go to add a new connector for Odoo ? https://discuss.airbyte.io/t/odoo-xmlrpc-source-development/441

Hello All! I am using open source Airbyte on EKS and trying to set up a S3 destination. Getting below error

Could not connect to the S3 bucket with the provided configuration. Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: VEWP01YGPY0JMN6T; S3 Extended Request ID: +DLkF/GRo7Udb8jZR4QQUOEiXU9QzsYFFfmKsceaaoQeir9m5qsXk69uS/Ouv1oUQpPdyAo0iPU=; Proxy: null)

I can see some connection test files getting created in the bucket. I have passed access and secret access key and applied below policy to the bucket

Action = [
            "s3:ListBucket",
            "s3:GetObject",
            "s3:PutObject",
            "s3:PutObjectAcl",
            "s3:AbortMultipartUpload"
          ],
          Effect = "Allow"

Could someone please help me understand the issue here? Thanks!

hey yall, what is the downtime of upgrading a connector in airbyte? cc @John (Airbyte), are there any risks I should know of?

Hi everyone!. I’m trying to create a connection between salesforce and s3, i created the source and the destination succesfull but when i setup de connection i have the error “non-json-response”. See the next image. When i review the server logs i found an error related to internet connection but mi server have internet connection, my others connections are running correctly. Also there is a reference to the format destination, i try with json with and without compression and i have the same error. Someody can hepl me. i attach the server logs. Thank you very much!

Connector upgrading is not working for me. It was working this morning with the same configuration 😕 I'm using Airbyte Open Source 0.40.32

Has any one successfully synced a Jira <> Snowflake connection? I seem to continually hit this error on certain streams (such as _board_*).*

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 111, in read
    yield from self._read_stream(
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 180, in _read_stream
    for record in record_iterator:
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 290, in _read_full_refresh
    for record_data_or_message in record_data_or_messages:
  File "/airbyte/integration_code/source_jira/streams.py", line 192, in read_records
    for board in super().read_records(**kwargs):
  File "/airbyte/integration_code/source_jira/streams.py", line 90, in read_records
    yield from super().read_records(**kwargs)
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 413, in read_records
    yield from self._read_pages(
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 430, in _read_pages
    yield from records_generator_fn(request, response, stream_state, stream_slice)
  File "/airbyte/integration_code/source_jira/streams.py", line 81, in parse_response
    yield self.transform(record=record, **kwargs)
  File "/airbyte/integration_code/source_jira/streams.py", line 197, in transform
    record["projectId"] = str(record["location"]["projectId"])
KeyError: 'projectId'

Anyone successfully set up Pardot as a source? Getting this error

requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: <https://pi.pardot.com/api/emailClick/version/4/do/query?format=json>
2023-02-09 16:51:12 [44msource[0m > Finished syncing email_clicks
2023-02-09 16:51:12 [44msource[0m > SourcePardot runtimes:
Syncing stream email_clicks 0:00:00.061133
2023-02-09 16:51:12 [44msource[0m > 400 Client Error: Bad Request for url: <https://pi.pardot.com/api/emailClick/version/4/do/query?format=json>
Traceback (most recent call last):
  File "/airbyte/integration_code/main.py"

hey there 👋 I'm deploying airbyte on k8s but worker fails to start with a StartContainerConfigError

Hi, I’ve just signed upto a 14 day trial but not all the connectors are there? The one I wanted to trial is https://docs.airbyte.com/integrations/sources/Commercetools but doesn’t show up in the dropdown. Any help from the airbyte team would be appreciated🔥

Hi guys! How are you? • Airbyte version: 0.40.26 • Source Postgresql version: 1.0.43 • Destination S3 version: 0.3.189 I'm facing a problem to load a table from PostgreSQL to S3. The first load fails without getting all the data, however it updates the state and sends the data to S3 (around 40Gb). After that, the loads should be incremental according to the cursor field, but the ingestion fails without updating the state and without sending any data to S3. The error seems to be similar to this thread but we are not able to solve it. Could you help me? I can send the logs if it is necessary. Thank you very much!

Is there a way to, within a stream, define the snowflake schema you would like the data written to? Taking that a step further, can you define a destination schema per table within the stream?

Hi All, I’m new to AirByte, have couple questions: 1. if we use AWS env., how to deploy AirByte for CDC? 2. Does AirByte support scaling when increase/decrease loads? 3. Can we tranform the CDC to some other format? 4. Does AirByte supports schema for CDC replication > 30MB?

Hey guys, can it be that when building a connector docker image on Mac and uploading it to docker hub I'm getting a wrong image architecture because I'm on M1 Mac?

Hey guys! Hope all is well 😁 Has a quick troubleshooting question about airbyte cloud I'm trying to sync Amplitude to Snowflake, and it was working properly until a couple days ago. Now it seems to be erroring out and giving this error message:

2023-02-09 19:05:46 [32mINFO[m i.a.w.g.DefaultReplicationWorker(getReplicationOutput):407 - failures: [ {
  "failureOrigin" : "source",
  "failureType" : "system_error",
  "internalMessage" : "argument of type 'NoneType' is not iterable",
  "externalMessage" : "Something went wrong in the connector. See the logs for more details.",
  "metadata" : {
    "attemptNumber" : 1,
    "jobId" : 465,
    "from_trace_message" : true,
    "connector_command" : "read"
  },

Airbyte version 0.40.20 Amplitude version 0.1.17 Snowflake version 0.4.40 On another note, I'm unable to update Amplitude to the current version, I just get a "Something went wrong.." error message Any help with this issue would be much appreciated 🙂

So I added a new thing to my source and i clicked the thing to reset, which was a terrible idea

if i restore an RDS snapshot, please tell me there’s some way to also get airbyte to continue where it left off

Running into an issue with the datadog source. When we setup the source the connection tests runs fine however when we try to setup a connection it comes up with something has gone wrong on the page you would normally select your streams. We have tested this with locally run airbyte and on airbyte running on kube and get the same issue on both. Have also tried multiple destinations and have confirmed the destinations work with other sources. Any ideas?

Facing an issue to sync data from Mongodb connector : our collection looks like this :

{
  order_placed_time: '2022-11-06T18:30:00.000Z',
  '': 'test',
  stateTransitionInfo: { ebndh1: { timestamp: 2022-11-07T10:07:22.648Z } },
  trackingId: 'OUZ3x9uF9keqdrqzTl5dTQ=='
}

There is an emtpy key in the collection document. The connector is not able to determine schema/catalogue with following error :

com.mongodb.MongoCommandException: Command failed with error 40353 (Location40353): 'Invalid $project :: caused by :: FieldPath must not end with a '.'.' on server

I need to be able to manage 200+ Airbyte connectors. 150 all configured the same; 40 the same; and a few ad-hoc ones. I’ve been looking at custom scripting this using the Airbyte api, but I thought I’d best ask the experts 1. how should I do this? 2. Are there any useful scripts already out there in the community?

Hi All. Setting up a NetSuite connection here. Auth is happening fine. User role was set up to spec in the documentation. But when Airbyte tries to load the schema for NetSuite I am getting “Error: non-json response”. The schema actually did resolve and display on screen once, but that was out of 15 attempts to connect. Ideas?

Hi team, I wanna to ask a question: Can airbyte merge different table in one source database to one table of target destination while sync data?

Hello team! How are you doing? I hope all is fine. We were deploying Airbyte OSS where I work and we would like to understand what are the S3/minio state variables used for (https://discuss.airbyte.io/t/what-are-the-state-storage-configuration-used-for/2415/2 - here it says it was deprecated, yet they still show up in the Helm Charts). Are they needed? Thanks.

Hello Joel, usually you past the certificates and the connector will insert them into the certificateStore. Did you try to remove the \n or other chars? Sorry the delay to reply!

Hi team, I wanna to ask a airbyte question: I want to use airbyte kafka source and I want to konw Spit to the binlog format of kafka, can the airbyte kafka source be parsed and read out?

Sorry guys, but can someone say how long do I have to wait code review? https://github.com/airbytehq/airbyte/pull/22469

Hey there, do you know how I can stop access to system tables in the Airbyte DB2 adapter? Our DB2 user only needs access to certain tables and shouldn't be able to see the system tables. Any help you can offer would be much appreciated. Thanks for your suggestions!

Hello All! I am using open source Airbyte on EKS and currently adding connections using the UI. Is there a way of adding connections using code? Thanks!

Hello Airbyte community 😊 I am using Airbyte on EKS using a Helm chart and trying to connect to the API, As per the Airbyte Docs,

When authenticating to the Configuration API, you must use Basic Authentication by setting the Authentication Header to Basic and base64 encoding the username and password (which are airbyte and password by default - so base64 encoding airbyte:password results in YWlyYnl0ZTpwYXNzd29yZA==). So the full header reads 'Authorization': "Basic YWlyYnl0ZTpwYXNzd29yZA=="

However I am still getting forbidden responses, What am I missing? Thanks in advance, Rob

Hi all, I am running command - ./gradlew airbyte integrationsconnectorsdestination &lt;name&gt;build to build my newely created destination connector but getting below error. Can any one help ?