Hi, all. Can *`S3`* URL be used for specifying the...
# troubleshooting
m
Hi, all. Can
S3
URL be used for specifying the jar location for application mode deployments? Last I tried Flink 1.18 + operator 1.9 they were still complaining that only
local
scheme was supported... Do I need to upgrade flink as well to 1.19.1? I'm pretty sure I saw S3 support for jarURI added in 1.19 version of Flink.
r
did you get a response?
m
No, but apparently flink 1.19+ supports it. Gonna try soon.
Merely upgrading the operator to 1.9 is not enough.
r
yeah, I've been reading that you need to install the s3a plugin on the operator pod, and that should do it
it should just use the pluggable filesystems - but I can't find any docs on exactly how
m
jars with plugins go into plugins dir of the Flink distribution. The plugins had been around for a while. What wasn't supported before is having the jar on S3 - you had to create an init container on your application (Deployment mode) and place the jar with "local" protocol so blob server can serve it for task manager scaling operations.