HI, are there issues with model hosting on hugging...
# agents
c
HI, are there issues with model hosting on huggingface or end of turn model? I deployed on our cloud environment and see all files are there, but keep getting these errors: 2025-11-24T210353.534107611Z stderr F RuntimeError: livekit-plugins-turn-detector initialization failed. Could not find model livekit/turn-detector with revision v0.4.1-intl. 2025-11-24T210353.534104761Z stderr F raise RuntimeError( 2025-11-24T210353.534102135Z stderr F File “/opt/venv/lib/python3.11/site-packages/livekit/plugins/turn_detector/base.py”, line 146, in initialize 2025-11-24T210353.534096904Z stderr F runner.initialize() 2025-11-24T210353.534094124Z stderr F File “/opt/venv/lib/python3.11/site-packages/livekit/agents/ipc/inference_proc_lazy_main.py”, line 64, in initialize 2025-11-24T210353.534090813Z stderr F Traceback (most recent call last): 2025-11-24T210353.534072357Z stderr F error initializing inference runner 2025-11-24T210353.086353509Z stderr F Could not find model livekit/turn-detector with revision v0.4.1-intl. Make sure you have downloaded the model before running the agent. Use
python3 your_agent.py download-files
to download the models. With the exact same Dockerfile; deployments have been going good for weeks, and all of a sudden we are seeing these errors, also with v0.4.0-intl. Also after checking files seem to be present there in /root/.cache/huggingface…. We have been deploying with the same Dockerfile for months, no changes made, and after a deployment today it started showing these errors. Could there be anything wrong with the models hosted on huggingface or errors over there?
l
c
Thanks @lively-winter-88668 I checked but not sure if it would resolve, the thing was, we deployed the same exact Dockerimage (see Dockerfile below) at 16:57 yesterday, works good, after that at 20:14 and the issue started happening. Using 1,2,18 initially. We run with python -m command, also downloading the models, which still should be working fine for download of models and running the agent right? Hereby the dockerfile, I am not sure if it might be something with the python:3.11-slim or something else: FROM --platform=linux/amd64 python:3.11-slim as builder WORKDIR /app RUN apt-get update && apt-get install -y --no-install-recommends build-essential wget git locales && rm -rf /var/lib/apt/lists/* && localedef -i nl_NL -c -f UTF-8 -A /usr/share/locale/locale.alias nl_NL.UTF-8 ENV LANG nl_NL.utf8 COPY requirements.txt setup.py pyproject.toml ./ RUN python -m venv /opt/venv ENV PATH="/opt/venv/bin:$PATH" RUN pip install --no-cache-dir wheel && pip install -r requirements.txt FROM --platform=linux/amd64 python:3.11-slim WORKDIR /app RUN apt-get update && apt-get install -y --no-install-recommends locales && rm -rf /var/lib/apt/lists/* && localedef -i nl_NL -c -f UTF-8 -A /usr/share/locale/locale.alias nl_NL.UTF-8 ENV LANG nl_NL.utf8 COPY --from=builder /opt/venv /opt/venv ENV PATH="/opt/venv/bin:$PATH" COPY agents1/ ./agents1/ RUN mkdir -p /app/credentials ENV GOOGLE_APPLICATION_CREDENTIALS="/app/credentials/google-credentials.json" RUN python -m agents1.agent.agent download-files CMD ["python", "-m", "agents1.agent.agent", "start"]
b
I'm also facing the same issue. It worked fine yesterday for me, and today somehow it raises this error
c
@lively-winter-88668 could it be that something has changed with models on huggingface reference wise that might be causing this and doing validation can be going wrong. Just to be sure. In addition; download of the models goes well on my side, I see everything is there in /root/.cache/huggingface, but it isn’t finding things at runtime.
@big-application-86058 can you also share your Dockerfile? I am curious to see if we have the same structure etc.
b
I don't run with docker, I use command line to run download-files and then run
python main.py dev
I also see everything inside the cache
l
Just checking, you're using
turn_detection=MultilingualModel(),
?
b
For me, I got the error with both English and Multilingual model @lively-winter-88668
l
OK, let me check with the team if anything changed lately. @big-application-86058 are you saying you cannot run
uv run python src/agent.py download-files
for the https://github.com/livekit-examples/agent-starter-python ? That is working for me this morning
c
@lively-winter-88668 yes correct (MultilingualModel()), and the error happens when the threads and worker starts
b
I can run download-files without any problems, and I also see the files in the Hugging Face cache. It's just weird that it says it cannot find the model livekit/turn-detector with revision... And yes, everything worked fine yesterday, so I'm quite confused. I'm running LiveKit version 1.2.18 and 1.3.1.
c
I have exact the same issue @big-application-86058 files are there in .cache/huggingface directories, refs, blob etc.
👍 1
l
I can reproduce this, thank you both, will check with the team.
c
Ahh good to know, I thought I was turning insane.
Thanks for following up so quickly @lively-winter-88668 . This currently prevents us for rolling out new functionalities (because our EOU is key for our customers). Do you have any clarity on fixing timelines for this by any chance? Or too early to say?
l
I hope soon, engineering are on it.
c
Great, looking forward to your feedback, so we can get this resolved and we can test it further. @lively-winter-88668 just thinking out loud: would it also be possible to put the EOU model files in a directory and have them more locally or in git, so they are copied from there during build, rather than through download-files? Or is this not a recommended way?
l
The files are being downloaded OK. A workaround is in progress at https://github.com/livekit/agents/pull/4084. If you look in the detail of that PR, it shows the root cause was a change made to huggingface yesterday, which is why you only now saw this issue.
c
Great, thanks Darryn. Will keep an eye on it.
c
That works, thanks!
Thanks again @lively-winter-88668 for the follow up and good communication on this issue today. Much appreciated!
l
🎉 Thanks for raising. The "fix" was incorporated into https://pypi.org/project/livekit-agents/1.3.5/
💯 1
🙌 1