trying to use Beam with Flink on Kubernetes using the flink-operator.
I can run Beam jobs on a Session Cluster, but I note that it only spins up a single TM. Isn’t the operator supposed to be looking at the number of tasks and auto-scale the number of TMs to match the need?
or is this happening because Beam does not actually submit the job to the operator, but directly to the JobManager?