This message was deleted.

Yes. Just because of adaptive batching.

Thanks Jiang! So, If I want to enable adaptive batch, just add

bentoml.Runnable.method(batchable=True)

option right?

You will have to ensure your model does accept batch inputs before

Thank you very much!