Hi, question for snappy-java native library. I'm t...
# troubleshooting
s
Hi, question for snappy-java native library. I'm trying to figure out how to configure the native library.so dynamical loading to somewhere else than
/tmp/
. I have noticed that its probably happening within the s3-fs-presto plugin and my question is that how could I configure that context? It seems that
java.io.tmpdir
doesn't propagate correctly into the plugin.
i.e. I'm keen to setup
Copy code
org.xerial.snappy.tempdir
I'm using pyflink cli for graph submit to a standalone cluster
d
You can pass at job submission time like this
Copy code
export FLINK_ENV_JAVA_OPTS="-Dorg.xerial.snappy.tempdir=/path/to/your/custom/tempdir"
# then run your PyFlink script or command
python your_job_submission_script.py
s
Thanks! I'll try it out
d
sure otherwise maybe in flink-conf.yaml
Copy code
env.java.opts: "-Dorg.xerial.snappy.tempdir=/path/to/your/custom/tempdir"
πŸ‘ 1
s
probably the latter as the loading happens after first checkpoint in taskmanagers
d
oh ok
s
It worked, thanks!
I used property
env.java.opts.taskmanager
as it is the instance that runs the plugin
d
Glad it works!