https://pulsar.apache.org/ logo
Join Slack
Powered by
Hi all, Im running Pulsar Functions on my Pulsar c...
# general
o
Hi all, Im running Pulsar Functions on my Pulsar cluster, within the broker. Im facing an issue here, whenever my Pulsar broker restarts (currently in Dev so the number of replicas is set to 1), my Pulsar functions don’t restart properly. And when I query for the status of the function, I get the following 
HTTP 503 Service Unavailable
error. I then have to manually restart the function. As I understand it, this is because when the broker restarts, it creates the functions but the function worker service is not up at the time and so the function creation fails with the 503 error. Am I missing something wrt to I how I’ve configured my functions or function worker? The only function worker config I have changed is that I use the 
ThreadRuntime
. Would love some input on how I can ensure the function starts up properly and doesn’t require manual intervention. Attaching logs here for the stack trace. Thanks!
pulsar-broker19-02-2024323.log
@Ming could you provide some help here?
m
If the function runs a thread runtime, can you make sure this is configured 
functionRuntimeFactoryClassName: org.apache.pulsar.functions.runtime.thread.ThreadRuntimeFactory
in functions_worker.yaml it looks like your function worker is not configured properly. Maybe test which function endpoints work that can give some clue where is broken.
o
Attaching the configs here, the runtimeFactory is already configured. Perhaps there’s something else here?
functions_worker.yml
None of the function endpoints work, and all of them have to be manually restarted
One thing Im seeing is that in 
broker.conf
functionsWorkerEnablePackageManagement=true
but in the 
functions_worker.yml
its set to false 
functionsWorkerEnablePackageManagement: false
Could the difference be the reason this is happening? And since Im trying to use the official apache/pulsar helm chart is there a way to set this through that?
@Ming any thoughts on what else could be missing? I do think it is a function worker config issue but not sure what configs here. Haven’t found any leads in the Pulsar documentation either
a
@Neng
🙌 1
n
functionsWorkerEnablePackageManagement
is for uploading function/connector jars with the 
pulsar-admin packages ...
cmd.
✅ 1
could you also try with the process runtime and see if the functions can be restarted properly?
want to validate if it’s a threadruntime problem or other issues.
o
@Neng I am using package management with Functions
thats why I asked
alright let me run this in process run time and see what happens
Open in Slack
PreviousNext
Powered by