This message was deleted.

did you try

bentoml serve …  --api-workers=2

?

There was 5 processes after I specified --api-workers 4, but then I figured out that there is also the main process and they stopped spawning.

with --api-workers=4, you should have: 4 api worker processes 1 runner process for each runner 1 circusd process managing all processes