This message was deleted.

How about just artifact.model.to(device) ?

hi Mayur, thank you for your response. I do also thought about using torch.nn.Module.to() function but i have to put the same logic for all of my endpoint definitions in the bentoml service. So its not that convenient. If there is a function that called on startup it will be great to put it there i guess.

makes sense

Thank you, this is a good suggestion. We are already considering adding post and pre start hooks.