Hi, I want to create workflow postgresql CDC -> S3 -> Redshift raw schema -> Redshift processed schema. From Airbyte documentation ai will need to create 3 flows: 1. Postgresql -> S3 2. S3 -> Redshift raw schema 3. Redshift raw schema -> Redshift processed schema. Is it possible to create dependency on those 3 flows inside Airbyte?
11/10/2021, 6:55 PM
Why not use AirbyteOperator in Airflow, so all would be managed from there. Yes additional tool, but Airbyte wasn't designed for something you're trying to achieve.