This message was deleted.

No first class documentation for that case yet. But if you look at one of the frameworks like this: https://github.com/bentoml/BentoML/blob/main/bentoml/_internal/frameworks/sklearn.py You can see the idea is to extend the "BaseModelRunner" and then implement the run_batch method, along with other methods you may want to override