can someone help me out?

I added a new source, Dameng, and used a new driver. When I created a new source, the error was reported as follows:

The newly added source, Dameng needs to use the new driver DmJdbcDriver18.jar, how should I deal with this file? who can help me？

Hi, can we get an update on the field selection feature? The issue is now officially the most popular in github, and the last update was a month ago saying it was being actively worked on. I think a lot of people would appreciate an ETA, or a confirmation that there is no ETA so we can look into other solutions.

Hello everyone 👋 I need help 🙂 I would like to know the name of the Airbyte source in my RabbitMQ destination. Is it possible? I have an airbyte connection, Notion to RabbitMq. When I get a rabbitmq message containing a payload from the notion connector, I have no way to know who produced that message.

Hi Team, I am following this doc: https://docs.airbyte.com/quickstart/deploy-airbyte/

but getting following error: 2023-03-10 09:57:13 WARN i.a.d.c.DatabaseAvailabilityCheck(check):38 - Waiting for database to become available...
2023-03-10 09:57:13 ERROR i.a.b.Application(main):25 - Unable to bootstrap Airbyte environment.
io.airbyte.db.init.DatabaseInitializationException: Database availability check failed.

Hi There, I am getting the below error while deploying airbyte on the local environment with docker. docker logs airbyte-server | grep ERROR 2023-03-10 100004,820 main ERROR Unable to load mask data from 'seed/specs_secrets_mask.yaml': null. 2023-03-10 100148 ERROR i.a.s.a.ApiHelper(execute):37 - Unexpected Exception 2023-03-10 100148 ERROR i.a.s.e.UncaughtExceptionHandler(handle):28 - Uncaught exception

docker logs airbyte-worker | grep ERROR 2023-03-10 100003,434 main ERROR Unable to load mask data from 'seed/specs_secrets_mask.yaml': null.

Hi Team 🙂 Hope you’re alright, I’m having a hard time understanding the relation between workers and connections jobs: • I have read on an older post in this slack that each worker will be (or is) dedicated to only one connection, is that still plan or already developed? My understanding is that for now a worker can plan jobs from any connection • The only difference (Airbyte side) between docker and kubernetes deployment is that: ◦ In docker one container is created by connection and its associated jobs are running into it ◦ In k8s one pod is created by connection and is running the dedicated jobs ◦ The settings are made with the same env variables

MAX_SPEC_WORKERS

etc.. • I did not understand how many jobs a worker can manage, is that a configuration to be done in the .env ? Thanks 🙂

Hi Guys, I have a postgres table that contains up to 50 million records. This needs to be replicated to another postgres database. The replication is working fine. However, two tables are generated, the normalized table and a table that contains the record in json format. Is there any way to stop the json formatted table from replicating as this is consuming large volume on the database. Thanks

Hello Guys, I am stuck with airbyte deployment on k8s using helm charts. Details in community thread. any inputs highly appreciated.

hi all, I'm having issues running airbyte on a CentOS 7 when following the steps:

git clone --depth 1 <https://github.com/airbytehq/airbyte.git>
cd airbyte
./run-ab-platform.sh

Error I'm getting is the following: 2023/03/10 124151 [emerg] 1#1: socket() [:]80 failed (97: Address family not supported by protocol) nginx: [emerg] socket() [:]80 failed (97: Address family not supported by protocol) /docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration /docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/ /docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh 10-listen-on-ipv6-by-default.sh: info: ipv6 not available /docker-entrypoint.sh: Launching /docker-entrypoint.d/20-envsubst-on-templates.sh 20-envsubst-on-templates.sh: Running envsubst on /etc/nginx/templates/default.conf.template to /etc/nginx/conf.d/default.conf /docker-entrypoint.sh: Launching /docker-entrypoint.d/30-tune-worker-processes.sh /docker-entrypoint.sh: Configuration complete; ready for start up Can anyone provide support?

Hey all, I’m new to airbyte so I’m curious if there’s a built-in way to handle incremental sync when a source only supports page-based pagination? E.g. we’re trying to create a new connector and the source API only has

nextPage

and

pageSize

to work with, and we aren’t concerned with deleted records. I’m trying to do as much of this with the low-code UI and YAML, but it seems like the only options for incremental sync are with cursor based pagination w/ timestamps? Can anyone guide me in the right direction here? Basically, it seems like it would suffice if we could just remember the last page we synced, and start there on our next sync & de-dupe the results. Seems pretty basic, so I definitely feel like I’m missing something

Hi, can someone from the airbyte team please have a look to the following issue: https://github.com/airbytehq/airbyte/issues/23716 There's multiple people suffering from it and it makes setting up airbyte practically impossible...

Hello all,

Facing issue while opening WebUI in my local installation. Getting UnresolvedAddressException after login. Has anyone faced this before?

hopefully a very simple question about upgrading Airbyte to 0.41.0: I have it deployed on a GCP compute engine VM, and would be using the wget command to pull and overwrite the .env and docker-compose files. Will my connections be preserved when I update in this way?

Hello 👋 I am testing the slack source, but I have an error. There are some debug logs in the HTTPStream used by Slack, but none of them shows up in my airbyte logs (locally, I am using the open source version). Any idea why? I have set the variable

LOG_LEVEL=DEBUG

in my .env file and restarted airbyte, but it does not help.

Any chance to see Salesforce as a Destination Connector this year ? My CRM team complain about it, arguing it's impossible for them to retrieve data from BigQuery and push it into Salesforce 😕

Is it possible to see the log output of the different connectors in Kubernetes? I would love see them in tools like K9s without resorting to a UI

Hello everyone, and happy Friday from the Community Assistance team. We’re asking for a little bit of time from you, the community members, on how to improve the experience of getting help (and helping others) here. We’ve created a small survey for folks around some of the planned changes to how the Community Assistance Team can be more effective. We’d like to get your thoughts on it, so we created a 5-question survey: https://forms.gle/p4qHEvUrt71HcDc78 We’ll be closing the survey on Tuesday so get your feedback in ASAP! If you feel inclined to fill out the survey, we’re also doing a raffle for some Airbyte merch as a thank you for your time and attention.

Hello, I am trying to install airbyte in AWS EC2 instance using Amazon linux 2, I am getting WARN[0000] The "STRICT_COMPARISON_NORMALIZATION_TAG" variable is not set. Defaulting to a blank string. service "bootloader" didn't complete successfully: exit 255. How could I fix this error? Thanks

Is it possible to make my Airbyte deployment run faster? Maybe by increasing the number of the worker. My instance is running Google Kubernetes Engine.

Guys, the greenhouse connector is not working? For me it's stuck on that screen.

Hi Guys! I'm trying to set up airbyte (version 0.41.0) on a MariaDB RDS machine in AWS, but I'm getting a lot of sync errors because of DDL Statements. "DDL statement couldn't be parsed. Please open a Jira issue with the statement 'SET STATEMENT max_statement_time" Anyone know how can I filter it? Or add the skip.unparseable.ddl option to the Debezium MySQL connector configuration? Thanks!

How can I keep the exact case when the table is created, for mysql to mysql replication, the table created in the destination is all lowercases. For example, the table name geoIP_range become geoip_range.

Is there ever a case where

_airbyte_ab_id

is not unique?

Has anyone been able to deploy AirByte on AWS in EKS?

Hi I submitted my first PR for a source! But when I test it locally, it isn't showing up in the UI. What am I missing?