Hi what is the recommended way to update log level dynamically in a running flink app on EMR?

Use the Rest API e.g.

curl -X POST \
     -H "Content-Type: application/json" \
     -d '{"logLevel": "DEBUG"}' \
     http://<master-node-ip>:8081/jobs/job_123456789/vertices/vertex_987654321/log

Interesting. I guess I would need some way to list all vertices of a running job. Also is there a way to specify package names where log level is changed?

Use the Flink Web UI to find it.

Hmm I am avoiding using the Web UI because this needs to be like a simple script which we can run to enable logs dynamically when there is an issue. Since we have a lot of task managers doing it via Web UI may not be the best approach for us.

Rest API is I’m sure what Web UI uses under the hood.

Ahh ok. So maybe I can try that. Thanks!

Sure! Good luck!