Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

Hi,
I wanted to clarify whether airbyte allows you to create more than 1_000_000 connections? Is there a lot of hardware needed so that, for example, more than 1_000_000 jobs work in parallel?

Hi <@U02V0PDFUF7>, I'm curious about your use case, in which context would you need to create a million of connections?
There's virtually no limit to the connection number, you can increase parallelism by tweaking the following env variables:
```### APPLICATIONS ###
# Scheduler #
# Relevant to scaling.
SUBMITTER_NUM_THREADS=10

# Worker #
# Relevant to scaling.
MAX_SYNC_WORKERS=5
MAX_SPEC_WORKERS=5
MAX_CHECK_WORKERS=5
MAX_DISCOVER_WORKERS=5```
You can find more details about scaling Airbyte <https://docs.airbyte.com/operator-guides/scaling-airbyte|here>