melodic-arm-17634
12/05/2025, 7:14 PM{"level": "ERROR", "name": "asyncio", "message": "Task exception was never retrieved\nfuture: <Task finished name='agent_job_termination' coro=<AgentServer._handle_termination() done, defined at /usr/local/lib/python3.13/site-packages/livekit/agents/worker.py:1224> exception=ValueError('process object is closed')>", "exc_info": "Traceback (most recent call last):\n File \"/usr/local/lib/python3.13/asyncio/tasks.py\", line 507, in wait_for\n return await fut\n ^^^^^^^^^\nasyncio.exceptions.CancelledError\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n File \"/usr/local/lib/python3.13/site-packages/livekit/agents/ipc/supervised_proc.py\", line 245, in aclose\n await asyncio.wait_for(\n asyncio.shield(self._supervise_atask), timeout=self._opts.close_timeout\n )\n File \"/usr/local/lib/python3.13/asyncio/tasks.py\", line 506, in wait_for\n async with timeouts.timeout(timeout):\n ~~~~~~~~~~~~~~~~^^^^^^^^^\n File \"/usr/local/lib/python3.13/asyncio/timeouts.py\", line 116, in __aexit__\n raise TimeoutError from exc_val\nTimeoutError\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File \"/usr/local/lib/python3.13/site-packages/livekit/agents/worker.py\", line 1229, in _handle_termination\n await proc.aclose()\n File \"/usr/local/lib/python3.13/site-packages/livekit/agents/ipc/supervised_proc.py\", line 254, in aclose\n await self._send_kill_signal()\n File \"/usr/local/lib/python3.13/site-packages/livekit/agents/ipc/supervised_proc.py\", line 310, in _send_kill_signal\n self._proc.kill()\n ~~~~~~~~~~~~~~~^^\n File \"/usr/local/lib/python3.13/multiprocessing/process.py\", line 139, in kill\n self._check_closed()\n ~~~~~~~~~~~~~~~~~~^^\n File \"/usr/local/lib/python3.13/multiprocessing/process.py\", line 101, in _check_closed\n raise ValueError(\"process object is closed\")\nValueError: process object is closed", "timestamp": "2025-12-05T18:56:40.618918+00:00"}
...couple of other logs
worker process is not responding.. worker crashed?
worker process is not responding.. worker crashed?
worker process is not responding.. worker crashed?
worker process is not responding.. worker crashed?
worker process is not responding.. worker crashed?
worker process is not responding.. worker crashed?
worker process is not responding.. worker crashed?
worker process is not responding.. worker crashed?
Any idea why? How can i go about diagnosing what's causing this?melodic-arm-17634
12/05/2025, 7:18 PMmelodic-arm-17634
12/05/2025, 8:04 PM{"level": "ERROR", "name": "asyncio", "message": "Task exception was never retrieved\nfuture: <Task finished name='agent_job_termination' coro=<AgentServer._handle_termination() done, defined at /usr/local/lib/python3.13/site-packages/livekit/agents/worker.py:1224> exception=ValueError('process object is closed')>", "exc_info": "Traceback (most recent call last):\n File \"/usr/local/lib/python3.13/asyncio/tasks.py\", line 507, in wait_for\n return await fut\n ^^^^^^^^^\nasyncio.exceptions.CancelledError\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n File \"/usr/local/lib/python3.13/site-packages/livekit/agents/ipc/supervised_proc.py\", line 245, in aclose\n await asyncio.wait_for(\n asyncio.shield(self._supervise_atask), timeout=self._opts.close_timeout\n )\n File \"/usr/local/lib/python3.13/asyncio/tasks.py\", line 506, in wait_for\n async with timeouts.timeout(timeout):\n ~~~~~~~~~~~~~~~~^^^^^^^^^\n File \"/usr/local/lib/python3.13/asyncio/timeouts.py\", line 116, in __aexit__\n raise TimeoutError from exc_val\nTimeoutError\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File \"/usr/local/lib/python3.13/site-packages/livekit/agents/worker.py\", line 1229, in _handle_termination\n await proc.aclose()\n File \"/usr/local/lib/python3.13/site-packages/livekit/agents/ipc/supervised_proc.py\", line 254, in aclose\n await self._send_kill_signal()\n File \"/usr/local/lib/python3.13/site-packages/livekit/agents/ipc/supervised_proc.py\", line 310, in _send_kill_signal\n self._proc.kill()\n ~~~~~~~~~~~~~~~^^\n File \"/usr/local/lib/python3.13/multiprocessing/process.py\", line 139, in kill\n self._check_closed()\n ~~~~~~~~~~~~~~~~~~^^\n File \"/usr/local/lib/python3.13/multiprocessing/process.py\", line 101, in _check_closed\n raise ValueError(\"process object is closed\")\nValueError: process object is closed", "timestamp": "2025-12-05T20:01:23.456287+00:00"}
worker process is not responding.. worker crashed?worker process is not responding.. worker crashed?
worker process is not responding.. worker crashed?
worker process is not responding.. worker crashed?
worker process is not responding.. worker crashed?melodic-arm-17634
12/05/2025, 8:39 PMlively-winter-88668
12/08/2025, 9:40 AMmelodic-arm-17634
12/08/2025, 6:04 PMmelodic-arm-17634
12/08/2025, 6:05 PMlively-winter-88668
12/09/2025, 9:42 AM1.2.14, so you upgrading may be a coincidence.
⢠side note - It also seems that livekit sends ~80% of new sessions to the render agent, which is strange to me. i thought it would split them evenlyMe too, and those agent dispatch errors happen when the balancer can't find an available agent worker to accept the job.
melodic-arm-17634
12/09/2025, 5:08 PMdry-accountant-99441
02/16/2026, 12:57 AMmelodic-arm-17634
02/16/2026, 1:06 PMdry-accountant-99441
02/16/2026, 3:33 PM