For Airbyte deployment, has anyone or would anyone recommend deploying airbyte as an ECS Fargate? Any tips or processes to get it working properly?
m
Michel
11/25/2020, 6:11 AM
By mid-dec we will have the manifests for K8s. We need to see how easily they are transferable to Fargate.
Michel
11/25/2020, 6:12 AM
Actually one of the reason we've been using docker-compose is that is a fairly contained way for us to document the moving pieces in order to run airbyte
Michel
11/25/2020, 6:14 AM
Just did a quick check on Fargate, it seems there is a way to run a docker compose. (pretty sure it is not going to be that simple but it looks like a good starting point)
👍 1
j
Jins Kadwood
11/25/2020, 6:28 AM
Happy to continue to use the EC2 version. But would love to have an ECS option to manage auto-scaling etc
Jins Kadwood
11/25/2020, 6:51 AM
BTW im also happy to use the K8 option on AWS instead of fargate.
m
moshir mikael
03/09/2021, 9:05 AM
With Fargate, the issue would be docker in docker. Fargate does not support spawning a docker within a container.