Hi everyone,
I'm currently working on a project where we've deployed a Flink Session using the Flink Kubernetes Operator. We are trying to run a multi-language Beam pipeline on the cluster (pipeline is primarily using the Python SDK, but also uses the ReadFromKafka and WriteToKafka PTransforms which require a Java expansion service). We've successfully deployed this pipeline on the cluster, but are unclear about the best way to approach task manager autoscaling. Is there a recommended way to handle this when using a session cluster? Or alternatively, is there a way to deploy a multi-language beam pipeline as an Application deployment?