Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

Hi everyone, wishing you the best of the year to come.

I'm trying to schedule airbyte's runs on sources that fetch data from a "start_date" but it's not optimal since the volume of the data is only going to increase as the times goes. I sought help on this documentation :
<https://airbyte-public-api-docs.s3.us-east-2.amazonaws.com/rapidoc-api-docs.html#post-/v1/sources/update>

Would anyone have an example on how to use this with an orchestrator (Airflow in my case) and if it works ? (I see the issues is still open <https://github.com/airbytehq/airbyte/issues/10001>)

In my head i had something like a task in airflow making a post request to the airbyte endpoint and modifying a source parameters as shown in the example in the doc but i lack some experiences if someone already encountered the use case

Hello Nicolas Xu, it's been a while without an update from us. Are you still having problems or did you find a solution?

Hi <@U047YN5E9LL>!
Wishing you the best.
Did you find a solution for this? I'm trying to solve the same problem :sweat_smile: