Hello, how does the memory of python udf function ...
# troubleshooting
l
Hello, how does the memory of python udf function manage? How to configure? I am having this problem now. You can look at the uploaded log file. Can you tell from the log file why python server failed?
d
@Lee xu Could you check if there are suspicious outputs in the stdout/stderr file?
l
I can see is the log, the yarn in the container is broken, but can't see the useful information, in the web - the UI page see Taskmanager seems not up, and then got "Java. Lang. RuntimeException: Python callback server start failed!" Wrong? I don't know how to fix it?
How can this get python server log details, even if it is stopped?
d
@Lee xu I suspect that there are some problems with the virtual environment you used. Could you check if it is usable by running a simple job locally with the virtual environment on one node of the YARN cluster, that’s
Copy code
source flink-py-env-1.14.3-3.8.16.zip/venv/bin/activate
python word_count.py