Hi Flink Community, I am interested to see if there is anything equivalent to oozie workflow scheduler that allows - 1. Definition of stream processing actions as a DAG that can be scheduled as a Job on flink cluster. Each action can potentially use multiple operators, can persist data on external store or local state. 2. Invoking of dependent actions in the DAG when the data is ready 3. Can be defined DAG using high level abstractions like workflow.xml in oozie and can be deployed to the clusters 4. Periodicity can be defined for stream processing as continuous (on top of DataStream), hourly/daily/weekly etc on top of Table API 5. Multiple jobs can be bundled and deployed to the clusters Is there anything out there that meets above requirements? or anything in works or planned in future roadmap?

I haven't seen any discussion on this topic, so it's definitely not on the roadmap. I also doubt that this ends up in Flink; this sounds like something outside of Flink should do.

I agree, wondering if anything out there or equivalent

Do you think this operator would help your usecase? https://github.com/apache/airflow/pull/26664