Hello everyone 🙂 I am curious to know when you plan to integrate Prefect ?

Hey @Aldo M, great question. In your mind what would such an integration look like?

Something like this would be a good start. I'm considering the simplest way to orchestrate a few ELT jobs, I don't like the complexity of airflow and quite liked the experience of using Prefect in the past https://docs.airbyte.io/operator-guides/using-the-airflow-airbyte-operator

Hey @Michel I join Matt and I am quite jealous you developed an integration with Airflow and not yet for prefect, as Prefect experience is the best for now on my opinion.

Terrific we just had a convo with their team 🙂. We can create a prefect task by following the model of the one we have for Airflow I think the v0 could be out fairly quickly, especially if an expert from the community wants to take a stab at it 🙂

I think the best way to implement it on prefect will be through an API, as Prefect doesn’t have operators like Airflow.. I am in the process of learning settings of Airbyte, and I would like to know if you’ve already have a Trigger API for launching Sync with python script?

I am in the process of learning settings of Airbyte, and I would like to know if you’ve already have a Trigger API for launching Sync with python script? (edited)

Airbyte has an API to trigger jobs but not a lib/wrapper done in Python. I saw some people using OpenAPI Generator lib to help using Airbyte API with Python. I'll take a look in Prefect 🙂

@[DEPRECATED] Marcos Marx yes I would have used a OpenAPI or requests to trigger it. But if you could implement a lib for using the Airbyte API in Python, that would be great for Prefect users. I will follow the issue. 😁

Will follow closely, I'm not using Airbyte just yet but if I do, then it will be with Prefect, so will get involved 👍