Hi,
I'm trying to setup a prefect task to schedule...
# ask-community-for-troubleshootinga
Andreas
01/26/2022, 1:28 PMHi,
I'm trying to setup a prefect task to schedule Airbyte runs. Is there a way to pass parameters to Airbyte? For example if I want to have a backfill flow, is there a way to programatically set the Airbyte sources start_date? Thanks!
✅ 1
a
Augustin Lafanechere (Airbyte)
01/26/2022, 2:33 PMHi @Andreas, this is an interesting use-case but I don't think editing connector configuration is currently supported by Prefect, feel free to reach them to raise this. (cc @Abhi Vaidyanatha (Airbyte))
a
Andreas
01/27/2022, 8:09 AMThanks @[DEPRECATED] Augustin Lafanechere, I will check with Prefect.
Andreas
01/27/2022, 5:05 PM@Augustin Lafanechere (Airbyte), I did some research and it seems to be possible with Parameters in Prefect (https://prefect-community.slack.com/archives/CL09KU1K7/p1637837420334300?thread_ts=1637836794.333000&cid=CL09KU1K7)
So I would need a way in the Airbyte task to forward these parameters. Right now it seems like the Airbyte API doesn't have any options for that though?
3 Views