Slackbot
12/15/2022, 5:41 AMBenjamin Tan
12/16/2022, 1:37 AMBharath Krishna
12/20/2022, 3:10 PM@bentoml.Runnable.method(batchable=True, batch_dim=0)
def predict(self, contents) -> List[dict]:
.
.
.
return [<list of predictions>]
With this you can make it bachable.
Basically for bachable runner's predict method's return type should be List.