This message was deleted.

Could you please share the code snippet you used to save and load your model?

I’m following the tutorial here only changing the path to the path of the model stored locally And I’m trying to build an image from this script using

bentoml build .

https://docs.bentoml.com/en/latest/use-cases/large-language-models/vllm.html