Kriston Costa
07/21/2023, 12:32 AMCaused by: java.net.MalformedURLException: unknown protocol: local
at java.net.URL.<init>(URL.java:618) ~[?:1.8.0_372]
at java.net.URL.<init>(URL.java:508) ~[?:1.8.0_372]
at java.net.URL.<init>(URL.java:457) ~[?:1.8.0_372]
at org.apache.flink.configuration.ConfigUtils.decodeListFromConfig(ConfigUtils.java:133) ~[flink-dist-1.16.1.jar:1.16.1]
at org.apache.flink.client.cli.ExecutionConfigAccessor.getJars(ExecutionConfigAccessor.java:77) ~[flink-dist-1.16.1.jar:1.16.1]
at org.apache.flink.client.deployment.executors.PipelineExecutorUtils.getJobGraph(PipelineExecutorUtils.java:69) ~[flink-dist-1.16.1.jar:1.16.1]
The manifest for the job is largely unchanged, other than the flinkVersion: v1_16.
The jar config is defined as:
job:
jarURI: local:///opt/flink/usrlib/job.jar
I tried this for both 1.16.1 and 1.16.2. I suspect I鈥檓 just missing something silly here, but I don鈥檛 see any mention of local being deprecated or any additional steps to migrate a pipeline from 1.15 -> 1.16. Would anyone have any thoughts about what might be causing this parsing error?Gyula F贸ra
07/21/2023, 6:44 AMGyula F贸ra
07/21/2023, 6:44 AMGyula F贸ra
07/21/2023, 6:44 AMKriston Costa
07/21/2023, 12:56 PMconf.yaml and load it into the environment via env.configure(conf, env.getClass.getClassLoader).
Now that the StreamingExecutionEnvironment configure method supports overriding JARS we were inadvertently clobbering the correctly configured JAR with the local:/// JAR defined in the YAML file.
Tested out just calling conf.removeConfig(PipelineOptions.JARS) before setting the env config and the pipeline booted up without issue.