Piotr Pawlaczek
09/19/2023, 7:20 PMFlinkSessionJob
using PythonDriver
class but I’m not sure if I understand correctly how to pass my python code.
I have the following deployment:
apiVersion: <<http://flink.apache.org/v1beta1%7Cflink.apache.org/v1beta1>>
kind: FlinkSessionJob
metadata:
name: my-python-job
spec:
deploymentName: flink-session-deployment
job:
jarURI: <https://repo1.maven.org/maven2/org/apache/flink/flink-python/1.17.0/flink-python-1.17.0.jar>
entryClass: "org.apache.flink.client.python.PythonDriver"
args: ["-py", "<path to my python file>"]
parallelism: 1
upgradeMode: stateless
what should I pass in args
?
my <path to my python file>
should point to a directory on my session cluster or rather it should be path to external location (http, s3) similar to jarURI
?
Could you please advice?