Dear Flink Team, is it possible to use S3 as a bac...
# troubleshooting
b
Dear Flink Team, is it possible to use S3 as a backend for storing the jars and download them during the job execution, If so can someone provide and example of how to do this?
v
by chance bharath are you using yarn to run your flink jobs?
there is this
yarn.provided.lib.dirs
which tells yarn where to look for jars
we use that and put the required jars in hdfs where flink can find them
b
Hi @Varun Sayal, nope we are not using yarn. we are able to add hadoop & presto jars. In this specific use case we are trying to looking the jar to use in the job. currently we are puling the jars from a nexus repo, we want to migrate this to s3.
v
Gotcha, sorry I am not aware of a way to supply an s3 jar location when submitting the flink job via CLI