Anyone having a good answer to https://github.com/orgs/bentoml/discussions/4771?

By default,

bentoml serve

will run sub-services in separate process groups similar to what you’re trying to achieve. Just that sub-services are not directly accessible as an API. I really like the suggestion you made in the comment! Currently it requires user to explicitly define routing to sub-services. But we can certainly implement direct routing (e.g. with sub-service’s name in the API route prefix). Will discuss more with the team