Hello everyone, I am new in BentoML and OpenLLM. I...
# ask-for-help
g
Hello everyone, I am new in BentoML and OpenLLM. I have downloaded Mixtral-8x7B LLM model from huggingface and I have safetensors of the LLM. I want to load to local model with Bento and serve with OpenLLM in order to use LangChain for building an application. Is there a way to load the model?