Hey BentoML users, I ran into 2 separate issues tr...
# ask-for-help
w
Hey BentoML users, I ran into 2 separate issues trying some of the samples in the BentoML GH repo and curious if any of you have run into these before: 1. For some reason, my SD XL Turbo deployment was terminated without me requesting it, so I tried to redeploy but got this error message (do you know what it means?):
$ bentoml deploy .
`Error: [bentoml-cli]
deploy
failed: Failed to create deployment due to invalid configuration: request failed with status code 400: {"error":"organization lifespan has been exceeded"}` 2. I then thought I'd try to deploy one of the (v)LLMs, but both Mistral and LLama2 deployments gave the same error you see below (but it is different than the error for SD XL Turbo above):
$ bentoml deploy .
`Error: [bentos]
build
failed: Failed to import module "service": No module named 'fastapi'` `Error: [bentoml-cli]
deploy
failed: Failed to create deployment due to invalid configuration: Failed to build BentoService bundle (Lookup for traceback):`
Command '['/tmp/bento/py311/bin/python3.11', '-m', 'bentoml', 'build', '.', '--bentofile', '/tmp/bento/BentoVLLM/llama2-7b-chat/bentofile.yaml', '--output', 'tag']' returned non-zero exit status 1.
Any insight would be great! --Wesley
c
for the first issue, looks like either the free credit on your account has ran out or usage limit has reached. Upgrading to starter tier should solve the problem. For the second issue, you will need to pip install the dependencies
w
Hi Chaoyu, ok for the 1st one. For the 2nd one, why would I need to install anything on my computer when I want to deploy directly to BentoCloud? Does this mean that the
requirements.txt
file in the repo is missing a dependency?
c
I think in most cases we can get around it by lazily import packages so users don’t have to install any packages besides BentoML in their CI or dev environment. @larme (shenyang) could you help take a look at the BentoVLLM repo and its dependencies?