Amit Gelber
02/22/2024, 10:14 AMChaoyu
02/26/2024, 7:39 PMChaoyu
02/26/2024, 7:40 PMChaoyu
02/26/2024, 7:40 PMAmit Gelber
03/06/2024, 8:30 AMChaoyu
03/06/2024, 8:31 AMChaoyu
03/06/2024, 8:32 AMAmit Gelber
03/06/2024, 11:08 AMwith bentoml.models.create(
name='lora-use-case',
metadata={"studio": "sm", "type": "lora","use-case":"background", "height": 1024, "width": 1024}
) as model_ref:
# Copy the entire model directory to the BentoML Model Store
shutil.copytree(local_model_dir, model_ref.path, dirs_exist_ok=True)
print(f"Model saved: {model_ref}")
later on we created a service which execute bentoml.models.list() and filter on type and use case
in the old SDK i couldn't save it