as far as I understand AirByte runs each ingestion process in separate docker container. When it is possible to scale vertically to increase number of docker containers and data ingestion capabilities there can be a moment when vertical scaling will be not enough and horizontal scaling will be required.
I wonder how reliable your Kubernetis solution at this moment and if it is possible to already use in prod environment?
Davin Chia (Airbyte)
03/10/2022, 8:59 AM
Hi, the kubernetes solution powers Airbyte Cloud. Given enough resources, I’d say that it’s pretty reliable. Do you have specific concerns?
03/10/2022, 10:43 PM
Yes, it's reliable for us 👍 Running it on AWS EKS.