Hello, I'm trying to retrieve the metric number of "conversions" from Google Analytics custom reports, but I didn't find it. I've tried

"metrics": "ga:micro_conversions" / "ga:conversions"

but no row are returning. Would help me a lot 🙏 Thanks a lot!

For the new Airbyte API we do not find any refresh_schema or discover schema options like in configuration API. Any advise on where can we find those options on new Airbyte API ? or any plans to add in future.

Hi! Are there any benchmarks about performance reading from relational databases. We have some tables with hundreds of gigabytes to a few terabytes and we are wondering how Airbyte would perform in an scenario like that.

Hi team, is Airbyte API available in OSS? If only available in Cloud, is there any plan to support Airbyte API for OSS in the near future?

Hey folks! I’m trying to call Airbyte from Airflow using the

apache-airflow-providers-airbyte.

While most of the sync works ok one of them is throwing the error below

Traceback (most recent call last):
  File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/airbyte/operators/airbyte.py", line 77, in execute
    hook.wait_for_job(job_id=job_id, wait_seconds=self.wait_seconds, timeout=self.timeout)
  File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/airbyte/hooks/airbyte.py", line 66, in wait_for_job
    raise AirflowException(f"Timeout: Airbyte job {job_id} is not ready after {timeout}s")
airflow.exceptions.AirflowException: Timeout: Airbyte job 38384 is not ready after 3600s

That particular sync works OK in Airbyte and do not throw any error. _execution_timeout_ and _dagrun_timeout_ are not set,so this is probably nothing to do with Airflow itself.

Hello everyone! I'm trying to re-establish a connection between an on-premise MSSQL database (as the source) and my Redshift database (as the destination). Two weeks ago, it was working fine, but it was syncing every hour, and we wanted to sync it daily using a cron tab. We tried to fix it by re-deploying Docker/Airbyte, but now every time we try to establish a connection, it gives a non-JSON response error. Here are a few more details: • We need to use a VPN to access the on-premise database since our client only allows access through VPN. • We have tried using both OpenVPN3 and PPTP VPN. • We are deploying Airbyte on EC2 Linux. • When I deploy Airbyte on my local machine and connect to the client's VPN, the connection between the source and destination works. But when I simulate it on my EC2 instance, it gives a non-JSON response. Could it be an error in the EC2 configuration? Any ideas would be appreciated. Thank you!

Hi team, source definitions create API is not available in Airbyte 0.42.1 version(Open source). but it was available earlier version.

Hi all, I am integrate data from SQL Server 2017 with CDC enable to BigQuery. I found that first full updated data seem to have a different timezone with later incrementally updated data, so that the first updated data will not be updated anymore. Just like the image shown below. Anyone have this problem? What can I configure to fix it? What I have done: • I built Airbyte on GKE via helm, and have set both Server and Scheduler to be the same timezone. • SQL Server also be set in the same timezone

Hi Everyone, I m following this to setup my development environment on windows for Airbyte. Everything went fine until the step of "cd Development/" where I get the following message "-bash: cd: Development: No such file or directory" Any idea on how to solve this?

Hello everyone 👋, @Gabriele Lomuscio and I inherited an Airbyte project with custom sources and are trying to put it as “Config As Code” using the Octavia CLI (We need to apply the same configuration upon multiple environments). It seems though that we have to specify a “definition id” and “source name” but we’re not able to find any when it comes to our custom sources. We are probably missing something. Any help would be greatly appreciated : )

👋 Hello, team! i need help with error logs

Hey everyone, Wrong connector docker images are getting pushed which doesn’t have ARM builds. ARM machines which are loading latest images are failing.

Hi All, do we have Airbyte Source Connectors in Maven Repo separately or the Airbyte Project's maven dependency in maven?

Hello Guys I'm trying to open a PR for a Zendesk Support source change but I'm getting an error on: Can someone help me?

We are running AirByte in behing AWS ALB. The url is something like this

<http://alb_host/airbyte/*>

When that hits the AirByte server we get a blank page because it is not expecting the URL to start with

airbyte/

Is there a way to get AirByte to support handling that directory before the regular part of the URL

Hi, I defined the primary key when I selected the sync mode, but it doesn't explicitly appear 'primary key (id)' in the table structure after I loaded the data.

Error response from daemon: invalid mount config for type "bind": bind source path does not exist: /etl/airbyte/flags.yml

root@datalake:/etl/airbyte# ll /etl/airbyte/flags.yml -rw-r--r-- 1 root root 412 Apr 14 21:57 /etl/airbyte/flags.yml

This message was deleted.

This message was deleted.

Hi Airbyte team #C021JANJ6TY, Airbyte source-kafka record read is taking 2 hours for 40K records, Could you suggest anything for tuning

Hi Team .. do we have any example for implementing Python Http Api source with Cookie based authentication .. If so please help

Hi team, I'm trying to follow the tutorial https://airbyte.com/tutorials/configure-airbyte-with-python-dagster In these steps, we have the Setup Airbyte, where we clone the airbyte git. I want to ask that so the airbyte we clone will be inside the stargazer folder or if it will be outside (same level as dagster folder). Besides, when I try to run the dagster-airbyte check command, I have an error that said I need to perform "dbt deps", but as I understand, inside stargazer folder there is no dbt_project.yml, so my dbt deps is failed. I think I have misunderstood the tutorial somewhere, could you guys help me? Thank you very much

dagster-airbyte check --module assets_modern_data_stack.assets.stargazer:airbyte_reconciler

What name should I give to the schema which I am defining for a class named GetData inside my source.py file while making a airbyte http source connector

Hi, I am running airbyte via helm, using chart 0.44.7 to migrate from 0.35.*. During install the bootloader won’t start. There is no relevant logs in it. Is there any way to enable debug mode in it?

Hi, i am running Airbyte via helm, using chart 0.45.8. Anyone know how to configure timezone for all pods?

Hi, I'm following the tutorial https://airbyte.com/tutorials/configure-airbyte-with-python-dagster but when I open Dagster UI, I don't see the stargazer_users in the fetch_stargazer

This message was deleted.

Hello, how do i increase my waiting for server response time with by default is 5 minutes, and my discover_schema is not fetching in time, i already altered proxy_read_timeout to 1999 on docs/operator-guides/security.md and also altered auth proxy time on .env to 1999 but discovery schema still disconencts at 5m.

source-rss build fails with _ctypes error

ModuleNotFoundError: No module named '_ctypes'

python --version Python 3.9.13

airbyte/airbyte-integrations/connectors/source-rss (master)$ pip install -r requirements.txt

Obtaining file:///home/ubuntu/work/software/airbyte/airbyte-integrations/bases/connector-acceptance-test (from -r requirements.txt (line 1))

Installing build dependencies ... done

Checking if build backend supports build_editable ... done

Getting requirements to build editable ... done

Preparing editable metadata (pyproject.toml) ... error

error: subprocess-exited-with-error

× Preparing editable metadata (pyproject.toml) did not run successfully.

│ exit code: 1

╰─> [63 lines of output]

running dist_info

creating /tmp/pip-modern-metadata-gcskytg5/connector_acceptance_test.egg-info

writing /tmp/pip-modern-metadata-gcskytg5/connector_acceptance_test.egg-info/PKG-INFO

writing dependency_links to /tmp/pip-modern-metadata-gcskytg5/connector_acceptance_test.egg-info/dependency_links.txt

writing requirements to /tmp/pip-modern-metadata-gcskytg5/connector_acceptance_test.egg-info/requires.txt

writing top-level names to /tmp/pip-modern-metadata-gcskytg5/connector_acceptance_test.egg-info/top_level.txt

writing manifest file '/tmp/pip-modern-metadata-gcskytg5/connector_acceptance_test.egg-info/SOURCES.txt'

reading manifest file '/tmp/pip-modern-metadata-gcskytg5/connector_acceptance_test.egg-info/SOURCES.txt'

writing manifest file '/tmp/pip-modern-metadata-gcskytg5/connector_acceptance_test.egg-info/SOURCES.txt'

creating '/tmp/pip-modern-metadata-gcskytg5/connector_acceptance_test-0.0.0.dist-info'

Traceback (most recent call last):

File "/home/ubuntu/work/projects/lf/.venv/lib/python3.9/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>

main()

File "/home/ubuntu/work/projects/lf/.venv/lib/python3.9/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main

json_out['return_val'] = hook(**hook_input['kwargs'])

File "/home/ubuntu/work/projects/lf/.venv/lib/python3.9/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 181, in prepare_metadata_for_build_editable

return hook(metadata_directory, config_settings)

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/build_meta.py", line 451, in prepare_metadata_for_build_editable

return self.prepare_metadata_for_build_wheel(

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/build_meta.py", line 377, in prepare_metadata_for_build_wheel

self.run_setup()

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/build_meta.py", line 484, in run_setup

super(_BuildMetaLegacyBackend,

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/build_meta.py", line 335, in run_setup

exec(code, locals())

File "<string>", line 31, in <module>

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/__init__.py", line 108, in setup

return distutils.core.setup(**attrs)

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/_distutils/core.py", line 185, in setup

return run_commands(dist)

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/_distutils/core.py", line 201, in run_commands

dist.run_commands()

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands

self.run_command(cmd)

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/dist.py", line 1221, in run_command

super().run_command(command)

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 988, in run_command

cmd_obj.run()

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/command/dist_info.py", line 103, in run

bdist_wheel = self.get_finalized_command('bdist_wheel')

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", line 304, in get_finalized_command

cmd_obj = self.distribution.get_command_obj(command, create)

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 860, in get_command_obj

klass = self.get_command_class(command)

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/dist.py", line 966, in get_command_class

self.cmdclass[command] = cmdclass = ep.load()

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/setuptools/_vendor/importlib_metadata/__init__.py", line 208, in load

module = import_module(match.group('module'))

File "/home/ubuntu/.pyenv/versions/3.9.13/lib/python3.9/importlib/__init__.py", line 127, in import_module

return _bootstrap._gcd_import(name[level:], package, level)

File "<frozen importlib._bootstrap>", line 1030, in _gcd_import

File "<frozen importlib._bootstrap>", line 1007, in _find_and_load

File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked

File "<frozen importlib._bootstrap>", line 680, in _load_unlocked

File "<frozen importlib._bootstrap_external>", line 850, in exec_module

File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/wheel/bdist_wheel.py", line 28, in <module>

from .macosx_libfile import calculate_macosx_platform_tag

File "/tmp/pip-build-env-v5rs5ae2/overlay/lib/python3.9/site-packages/wheel/macosx_libfile.py", line 43, in <module>

import ctypes

File "/home/ubuntu/.pyenv/versions/3.9.13/lib/python3.9/ctypes/__init__.py", line 8, in <module>

from _ctypes import Union, Structure, Array

ModuleNotFoundError: No module named '_ctypes'

[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.

error: metadata-generation-failed

× Encountered error while generating package metadata.

╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.

hint: See above for details.

Hey everybody 🙂 I am new AirByte user, just getting things started. I am attempting to write my first connector in Python and couldn't find an up-to-date example to start from. I would really appreciate a lead 🙌