https://linen.dev logo
#feedback-and-requests
Title
# feedback-and-requests
j

Jeff Crooks

09/02/2021, 4:31 PM
is anyone using airflow and airbyte on the same instance? any gotchas to lookout for?
u

user

09/02/2021, 11:28 PM
I think @Matt Hardner deployed in GCP 😃 and maybe @Jaime Farres is using too
u

user

09/02/2021, 11:41 PM
We have a production setup of cloud composer and airbyte on a GCE instance. It has been stable for a couple of months now. If you have questions I’ll be glad to answer them
u

user

09/03/2021, 6:56 AM
Yes, we are using Airflow and Airbyte in a single EC2 t3.xlarge
u

user

09/03/2021, 12:28 PM
So I'm new to Airflow - If I'm just using it to orchestrate/schedule Airbyte runs, I'm assuming the workers aren't doing to much?
u

user

09/03/2021, 12:28 PM
i cant imagine its anything but start this process, wait for exit code
u

user

09/03/2021, 12:30 PM
and if thats the case am i over-engineering this? I just want to be able to have more flexibility with scheduling.
u

user

09/03/2021, 5:29 PM
also - upgrading docker-compose will that impact airbyte?
2 Views