Hello, how does the memory of python udf function manage? How to configure? I am having this problem now. You can look at the uploaded log file. Can you tell from the log file why python server failed?
@Lee xu Could you check if there are suspicious outputs in the stdout/stderr file?
l
Lee xu
03/23/2023, 7:03 AM
I can see is the log, the yarn in the container is broken, but can't see the useful information, in the web - the UI page see Taskmanager seems not up, and then got "Java. Lang. RuntimeException: Python callback server start failed!" Wrong? I don't know how to fix it?
How can this get python server log details, even if it is stopped?
d
Dian Fu
03/24/2023, 10:00 AM
@Lee xu I suspect that there are some problems with the virtual environment you used. Could you check if it is usable by running a simple job locally with the virtual environment on one node of the YARN cluster, that’s