This message was deleted.
# ask-for-helps
Slackbot
10/20/2023, 3:17 PMThis message was deleted.
t
Tim Liu
10/20/2023, 4:29 PMhave you tried serving the bento after it's built?
Tim Liu
10/20/2023, 4:29 PMMaybe there was a logging change?
b
Bastian Broekmans
10/20/2023, 4:44 PMWhen i try to run the bento as docker container i get the following: `Error: [bentoml-cli]
serveBastian Broekmans
10/20/2023, 4:45 PM/home/bentoml/models in the docker image is empty!
Bastian Broekmans
10/20/2023, 4:47 PMand also in the bento file structure there is only /src, /env and /apis folder => no model folder
t
Tim Liu
10/20/2023, 5:13 PMwhich version of bentoml is this?
Tim Liu
10/20/2023, 5:13 PMwhat OS are you running?
b
Bastian Broekmans
10/20/2023, 5:30 PM• OS: Ubuntu 22.04.2 LTS
• Python Version 3.9 (conda)
• BentoML Version 1.1.7
• Bentoctl Version 0.4.0
• Docker version 24.0.5, build ced0996
Bastian Broekmans
10/20/2023, 5:32 PMbentoml serve on the build server runs just fine because the model is local
x
Xipeng Guan
10/20/2023, 5:45 PMDid you build the Docker image using the "bentoml containerize" command?
b
Bastian Broekmans
10/20/2023, 6:02 PMyes, in this case the model is included an can be run via docker. I also try to publish it to azure container instances via bentoctl build -b iris_classifier:ag6m4ktpogvzp3jk -f deployment_config.yaml
Bastian Broekmans
10/20/2023, 6:02 PMthe generated container image is lacking the model
Bastian Broekmans
10/20/2023, 6:04 PMerrors out with │Start streaming logs:
│Error: [bentoml-cli]
servet
Tim Liu
10/20/2023, 6:10 PMsorry, I'm a little confused. You mentioned this error:
`Error: [bentoml-cli]
serveserveTim Liu
10/20/2023, 6:11 PMI'm guessing you're attempting to serve 2 different bentos?
b
Bastian Broekmans
10/20/2023, 6:11 PMi switched to another quck start guide after the first errors without success
Bastian Broekmans
10/20/2023, 6:11 PMsame error
t
Tim Liu
10/20/2023, 6:13 PMgot it
Tim Liu
10/20/2023, 6:13 PMcan you do a "bentoml models list"
Tim Liu
10/20/2023, 6:13 PMdoes the right model show up?
b
Bastian Broekmans
10/20/2023, 6:14 PM(bentoml) loginuser@cpurig1:~/layoutnet/bentotest$ bentoml models list
Tag Module Size Creation Time
iris_clf:gp6me4dplovzp3jk bentoml.sklearn 184.38 KiB 2023-10-20 151319
iris_clf:2rldevdplcvzp3jk bentoml.sklearn 186.96 KiB 2023-10-20 145620
Bastian Broekmans
10/20/2023, 6:14 PMas i said, it works locally with bentoml serve and with docker exec but not build with azure container instances build command
Bastian Broekmans
10/20/2023, 6:17 PMdocker images:
Bastian Broekmans
10/20/2023, 6:17 PMbentomleasy.azurecr.io/test 4scgn3tpoovzp3jk b6093f27d165 5 minutes ago 1.06GB DOESNT WORK!
azure-container-instances-iris_classifier 4scgn3tpoovzp3jk b6093f27d165 5 minutes ago 1.06GB DOESNT WORK!
iris_classifier ag6m4ktpogvzp3jk 0c00744c98ab 25 minutes ago 788MB WORKS!
Bastian Broekmans
10/20/2023, 6:20 PMazure-container-instances-iris_classifier> ls README.md apis bento.yaml env src
iris_classifier> ls README.md apis bento.yaml env models src
t
Tim Liu
10/20/2023, 6:22 PMah ok, got it got it. Probably a bentoctl issue then, right?
b
Bastian Broekmans
10/20/2023, 6:23 PMlooks like 😉
t
Tim Liu
10/20/2023, 6:39 PMWe have other contributers who are more familiar than I with bentoctl @Jithin James
But if you want to take a look at the code yourself, that would be a huge help
b
Bastian Broekmans
10/20/2023, 6:40 PMi alread try to understand what is going on there. I think this has something in common with https://github.com/bentoml/bentoctl/issues/212
Bastian Broekmans
10/20/2023, 7:09 PMError [BentoctlDockerException]: Failed to push docker image. error parsing HTTP 400 response body: invalid character '<' looking for beginning of value: "<html>\r\n<head><title>400 Request Header Or Cookie Too Large</title></head>\r\n<body bgcolor=\"white\">\r\n<center><h1>400 Bad Request</h1></cente
Bastian Broekmans
10/20/2023, 7:10 PMlooks like an issue with the azure container registry