Just exploring Airbyte for a possible solution for our team. I wanted to learn more about the connector scaling. We are needing to pull data from various custom sources on behalf of our users each with their own credentials. My understanding is we would have a connection setup for each on of these sources/user pairs. Is airbyte a viable option for this usecase? Will it scale well enough for my usecase? The docs reference "running over a thousand connections". I'm assuming that means actively syning over a thousand at a time. If it's active syncs then I suspect it would be fine for our usecase. If we bump up to any limits we can mitigate it with a queue or will the built in schedular handle it fine? https://docs.airbyte.com/operator-guides/scaling-airbyte

...only uncommonly large workloads will require deployments at scale. In general, you would only encounter scaling issues when running over a thousand connections.

As a reference point, the typical Airbyte user has 5 - 20 connectors and 10 - 100 connections configured. Almost all of these connections are scheduled, either hourly or daily, resulting in at most 100 concurrent jobs.