Hi team, do you have idea about how many connections the community airbyte version can support? Deployment is to AWS eks, kafka to s3 data sync every 10 minutes. Rough number is fine like hundreds or thousands? and if we want to scale to support more, any parameter tuning suggestions?

Hi @Liyin Qiu, Thanks for the question. We have a customer who’s using Airbyte OSS in production and they’re deploying hundreds of connections for their instance. It may be possible to scale to thousands but I don’t have any concrete examples to share with you. As far as scaling goes, take a look at our docs on scaling Airbyte. It may help you get a better picture of what we can support: https://airbytehq.github.io/operator-guides/scaling-airbyte/