Dear Flink Team, is it possible to use S3 as a bac...
# troubleshootingb
Bharath Reddy
04/10/2023, 9:15 AMDear Flink Team, is it possible to use S3 as a backend for storing the jars and download them during the job execution, If so can someone provide and example of how to do this?
v
Varun Sayal
04/10/2023, 4:44 PMby chance bharath are you using yarn to run your flink jobs?
Varun Sayal
04/10/2023, 4:44 PMthere is this
yarn.provided.lib.dirsVarun Sayal
04/10/2023, 4:44 PMwe use that and put the required jars in hdfs where flink can find them
b
Bharath Reddy
04/11/2023, 6:46 AMHi @Varun Sayal, nope we are not using yarn. we are able to add hadoop & presto jars. In this specific use case we are trying to looking the jar to use in the job. currently we are puling the jars from a nexus repo, we want to migrate this to s3.
v
Varun Sayal
04/11/2023, 2:00 PMGotcha, sorry I am not aware of a way to supply an s3 jar location when submitting the flink job via CLI