Hello everyone, I am using Flink with Docker Compo...
# troubleshooting
s
Hello everyone, I am using Flink with Docker Compose. Currently, I store the Job JARs in a Docker volume, and the JobManager accesses them using the
web.upload.dir
option. My problem is that when the JobManager container is restarted (or the host is rebooted), the jobs do not restart automatically, and I have to restart them manually. Does anyone have a solution for this, considering that I am not using Kubernetes and therefore I believe I cannot utilize High Availability? Thank you.
p
You can build your own image where the configs point to a specific jar.
s
Hi Pedro, Thanks for your answer. Would you be ok to elaborate a little bit? What config are you talking about and which properties/parameters specifically? Thanks 🙂
p
When I create a specific image (with no HA), my taskmanagers have the jobmanger ip/hostname (i think from docker compose hostname would be the solution) and the taskmanagers subscribe to the jobmanager. this makes them communicate properly. To achieve it i'd use the configs
Copy code
jobmanager.rpc.address: jobmanager
jobmanager.rpc.port:
The difference is that i'd pass those args to my job manager image (with the embedded jar in it) like this:
Copy code
args:
            - "standalone-job"
            - "--host"
            - "jobmanager"
            - "--job-classname"
            - "{{ classpath }}"