I want to download deepseek model in my local pc not use any LiveKit Community #ask-ai

Join Slack

I want to download deepseek model in my local pc n...

# ask-ai

red-agent-48266

05/15/2025, 5:28 PM

I want to download deepseek model in my local pc not use any api keys, is it possible in livekit

tall-airline-16756

05/15/2025, 5:28 PM

Thanks for reaching out, Hrithik. I'm an AI assistant and I'm here to help. Give me a moment while I research this topic.

tall-airline-16756

05/15/2025, 5:28 PM

Yes, it is possible to download the DeepSeek model locally without using API keys in LiveKit. The LiveKit plugins system, such as the turn detector plugin, provides a method to download models locally. You can use the

download_files

method in the

EOUPlugin

class to download the necessary model files from Hugging Face Hub. Here is an example:

Copy code

def download_files(self):
    from transformers import AutoTokenizer
    from .base import _download_from_hf_hub
    from .models import HG_MODEL, MODEL_REVISIONS, ONNX_FILENAME

    for revision in MODEL_REVISIONS.values():
        AutoTokenizer.from_pretrained(HG_MODEL, revision=revision)
        _download_from_hf_hub(
            HG_MODEL, ONNX_FILENAME, subfolder="onnx", revision=revision
        )
        _download_from_hf_hub(HG_MODEL, "languages.json", revision=revision)

To execute this, you can run:

Copy code

python3 your_agent.py download-files

This method allows you to download and use the models locally without requiring API keys for inference. Let me know if you need further assistance! Sources: Tree View: | dse-workbench | Tree View: | dse-workbench

red-agent-48266

05/15/2025, 5:29 PM

is it possible in node.js

tall-airline-16756

05/15/2025, 5:29 PM

Currently, I couldn't find specific instructions for downloading the DeepSeek model locally in Node.js without using API keys in LiveKit. The available documentation primarily focuses on Python implementations. However, you might be able to adapt the process by using Node.js libraries like

axios

node-fetch

to download files from Hugging Face Hub or similar sources. If you need further assistance or specific guidance for Node.js, please let me know, and I can escalate this to a specialist for more detailed support.

Open in Slack

Previous Next