Kee Hui Tiew
02/03/2025, 7:09 AMJian Shen Yap
02/03/2025, 3:19 PMbentoml.pytorch to give user more flexibility. To save your pytorch model with bentoml, we would point you to using the bentoml.models.create API
https://docs.bentoml.com/en/latest/build-with-bentoml/model-loading-and-management.html
which allow you to pack any arbitrary files into a "Model"Kee Hui Tiew
02/05/2025, 6:31 AMservice.py, I'm trying to load a list of BentoML models into a single variable. But when I do bentoml build and then bentoml export the .zip file doesn't contain the models.
It only works when each BentoML model is a variable.
I've replicated the unsuccessful code using the XGBoost example: https://github.com/TiewKH/BentoXGBoost/tree/main
May i know if this is expected?Jian Shen Yap
02/06/2025, 3:15 AMBentoModel. @Frost Ming could you confirm?Jian Shen Yap
02/06/2025, 3:15 AMclass CancerTiewKHClassifier:
# Retrieve the latest version of the model from the BentoML model store
# This fails
bento_model = [BentoModel(f"{model_name}:latest")]
# This works
# bento_model = BentoModel(f"{model_name}:latest")