This message was deleted BentoML #ask-for-help

This message was deleted.

Slackbot

01/18/2023, 12:24 AM

This message was deleted.

🏁 1

01/18/2023, 12:33 AM

Hello @Li Wan Yes. You can create custom runner for that. You can look at the stable diffusion example. https://github.com/bentoml/stable-diffusion-bentoml/blob/main/fp16/service.py

Li Wan

01/18/2023, 12:33 AM

Thanks!

Li Wan

01/18/2023, 2:36 AM

Hi, any solutions for error:

Copy code

TypeError: Given model (<http://ViT-B-16-visual.pt|ViT-B-16-visual.pt>) is not a torch.ScriptModule.

where the

type

of model i passed is

Copy code

<class 'torch.jit._script.RecursiveScriptModule'>

3 Views