Hi! I have an application where I use BentoML 1.3...
# ask-for-help
x
Hi! I have an application where I use BentoML 1.3.2 and deploy two services. One depends on the other, and only one is accessible from outside. The code is identical to this: https://docs.bentoml.com/en/latest/build-with-bentoml/distributed-services.html I would like to assign resources to each service independently, but I see in the documentation that the "resources" parameter only takes effect in BentoCloud. Is there any way to specify the resources for each service if it's not deployed in BentoCloud? Thanks for your help!
c
Yes - 1. Deploy your 2nd service separately 2. Change the depends statement to use the deployed URL instead of the Python class
bentoml.depends( url="deployed_url" )
, see https://docs.bentoml.com/en/latest/reference/bentoml/sdk.html#bentoml.depends
the 2nd service could be running localhost (or another node) in its own docker container, where you can control the resource limits