Hello everyone, I am trying to run pyflink with a ...
# troubleshooting
e
Hello everyone, I am trying to run pyflink with a UDF locally (what flink apparently calls minicluster mode by using the
.wait()
function on a Table) But I get several Java errors. and this one bellow seems to be the main problem, it looks that it happens frequently to other people since I've seen it across stackoverflow:
Copy code
Caused by: java.lang.RuntimeException: Failed to create stage bundle factory! INFO:root:Initializing Python harness: C:\Users\eugen\anaconda3\lib\site-packages\pyflink\fn_execution\beam\beam_boot.py --id=6-1 --provision_endpoint=localhost:53973
INFO:root:Starting up Python harness in loopback mode.
I've seen a solution was to set one variable
_python_worker_execution_mode
to `process`: https://stackoverflow.com/a/72037218/9588300 However, I've set the variable and it gives the same error. This is how I've set it up in my .py file:
Copy code
from pyflink.datastream import StreamExecutionEnvironment
env = StreamExecutionEnvironment.get_execution_environment()
env.add_jars("file:///" + CURRENT_DIR + "/lib/flink-sql-connector-kinesis-1.15.2.jar")
table_env = StreamTableEnvironment.create(stream_execution_environment=env)
table_env.get_config().set("pipeline.jars","file:///" + CURRENT_DIR + "/lib/flink-sql-connector-kinesis-1.15.2.jar")
table_env.get_config().set("table.exec.sink.not-null-enforcer", "DROP")
table_env.get_config().set("_python_worker_execution_mode", "process")
Did I set it wrong?
@Dian Fu I see you posted the solution, do you happen to know if I've set the variable correctly on that code snippet ^^^ ?