This message was deleted.

I think this is overall correct. You can find additional info on the doc: https://docs.bentoml.org/en/latest/guides/batching.html