What should be the most preferred/suited for a pro...
# replication-ask-aif
Federico Cipriani Corvalan
09/12/2023, 2:56 PMWhat should be the most preferred/suited for a production: EKS or EC2?
k
kapa.ai
09/12/2023, 2:57 PMNew message text here
f
Federico Cipriani Corvalan
09/12/2023, 3:09 PMMany thanks! We run EKS along with other CNCF projects smoothly… Our issue arose when we tried to run Airbyte on EKS with more than 150 connections using a refresh time of less than 5 minutes per connection (to provide a near-realtime solution). A partial solution was to adjust node selectors accordingly, as well as to use RDS and S3 in order to avoid stateful persistent volumes. Still, we had issues in order to scale our use case. We would like to know if EC2 should be more stable for such a use case. Thanks in advance,
m
Matej Líner
09/13/2023, 7:27 AMHi @Federico Cipriani Corvalan I think that EKS is still better way of running airbyte at scale. Depends on the problem you have with your current EKS setup. Swithing to RDS and S3 (probably from minio) was a good and logical step forward.