Hi community. I see that defining a fine-tuned huggingface model service can be done like so (
link). So the workflow is to save the model into BentoML’s model store, then in service.py, we reference the bentoml model. In the example in the docs, it’s assumed that the model is called “unmasker:latest”, but I was wondering what’s the recommendation of structuring service.py if I expect many differently named bento models (e.g.,
unmasker
,
awesome-unmasker
,
unmasker-bert
) to be able to serve as the backbone model of this service.
edit: I guess this question also is relevant for building services with models with specific tags (other than
latest
)