This message was deleted.

Hi! These are runner workers. The config you have is only for api server, which is the

@svc.api

part. For better model serving, bentoml will optimize model runners automatically. You can control it by change visible CPU cores / GPUs

Thank you for your quick reply! So, to confirm, I should also adjust the runners.resources property as displayed in the screenshot from the runner configuration page?

@Robin de Heer Yeah. The doc is here: https://docs.bentoml.org/en/latest/guides/configuration.html#configuration