Is there a specific recommended format (like :hugg...
# ask-for-help
j
Is there a specific recommended format (like 🤗safetensors) for storing tensors/model in the model store. There is no mention to it in the official doc https://docs.bentoml.com/en/latest/guides/model-store.html. I've just read your very great blog article and you detail how you leveraged the zero copy capabilities of safetensor for model loading. Thanks for your help.
s
Safetensors is a great serialization format for storing weights. There is no limit to what you choose to use since you can customize the model loading logic in the service constructors.
j
Ok thanks, and is using safetensors will result in faster cold start compared to the normal pytorch serialization format (which is pickle under the hood I think)?
s
Yes. We expect so.
👍 1