Hey There, I had beam in production which was running immune without any issues. though past couple of months beam pipeline getting down without any trackback which is weird too. Anyways... I have decided to run the beam pipelines on top on Flink cluster and followed this blog https://flink.apache.org/ecosystem/2020/02/22/apache-beam-how-beam-runs-on-top-of-flink.html I have setup a Flink cluster on Kubernetes locally. I pulled flink:1.14.6 and apache/beam_python3.10_sdk:2.43.0. when I run python basic.py(beam pipeline code) it doesn't submit the job to Flink (I don't see any job on Flink UI) I searched on stack overflow and got to know that's version issues. the things is that no one know's which latest version is supported by both. can someone help me here...? Any help would be appreciated!

Beam documentation specifies Flink Version compatibility here https://beam.apache.org/documentation/runners/flink/#flink-version-compatibility