is anyone using airflow and airbyte on the same in...
# feedback-and-requestsj
Jeff Crooks
09/02/2021, 4:31 PMis anyone using airflow and airbyte on the same instance? any gotchas to lookout for?
u
user
09/02/2021, 11:28 PMI think @Matt Hardner deployed in GCP 😃 and maybe @Jaime Farres is using too
u
user
09/02/2021, 11:41 PMWe have a production setup of cloud composer and airbyte on a GCE instance. It has been stable for a couple of months now. If you have questions I’ll be glad to answer them
u
user
09/03/2021, 6:56 AMYes, we are using Airflow and Airbyte in a single EC2 t3.xlarge
u
user
09/03/2021, 12:28 PMSo I'm new to Airflow - If I'm just using it to orchestrate/schedule Airbyte runs, I'm assuming the workers aren't doing to much?
u
user
09/03/2021, 12:28 PMi cant imagine its anything but start this process, wait for exit code
u
user
09/03/2021, 12:30 PMand if thats the case am i over-engineering this? I just want to be able to have more flexibility with scheduling.
u
user
09/03/2021, 5:29 PMalso - upgrading docker-compose will that impact airbyte?
2 Views