This message was deleted.
# ask-for-helps
Slackbot
10/02/2022, 11:57 PMThis message was deleted.
👀 1
🏁 1
🍱 1
b
Bo
10/02/2022, 11:59 PMWhere are you deploying to?
g
Greg
10/03/2022, 12:01 AM@Bo Using the docker container to deploy to GKE cluster.
Greg
10/03/2022, 12:02 AMTried to get Yatai going, but decided to go old-fashioned. On the docket for later.
Greg
10/03/2022, 12:04 AM Copy code
2022-10-02T23:44:20+0000 [INFO] [cli] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:21+0000 [INFO] [cli] Environ for worker 0: set CUDA_VISIBLE_DEVICES to 0
2022-10-02T23:44:21+0000 [INFO] [cli] Starting production BentoServer from "/home/bentoml/bento" running on <http://0.0.0.0:3000> (Press CTRL+C to quit)
2022-10-02T23:44:23+0000 [INFO] [api_server:2] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:23+0000 [INFO] [api_server:5] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:23+0000 [INFO] [api_server:7] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:23+0000 [INFO] [api_server:6] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:24+0000 [INFO] [api_server:4] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:24+0000 [INFO] [api_server:8] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:24+0000 [INFO] [api_server:1] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:24+0000 [INFO] [api_server:11] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:24+0000 [INFO] [api_server:12] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:24+0000 [INFO] [api_server:9] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:24+0000 [INFO] [runner:stable_diffusion_runner:1] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:24+0000 [INFO] [api_server:3] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
2022-10-02T23:44:24+0000 [INFO] [api_server:10] Service loaded from Bento directory: bentoml.Service(tag="stable_diffusion_fp16:ysyakjscu2gc34xy", path="/home/bentoml/bento/")
/usr/local/lib/python3.9/dist-packages/torch/cuda/__init__.py:146: UserWarning:
A100-SXM4-40GB MIG 3g.20gb with CUDA capability sm_80 is not compatible with the current PyTorch installation.
The current PyTorch install supports CUDA capabilities sm_37 sm_50 sm_60 sm_70.
If you want to use the A100-SXM4-40GB MIG 3g.20gb GPU with PyTorch, please check the instructions at <https://pytorch.org/get-started/locally/>Greg
10/03/2022, 12:04 AMFull trace.
Greg
10/03/2022, 12:06 AMTrying now with
index-urlextra-index-url<https://download.pytorch.org/whl/cu116>a
Aaron Pham
10/03/2022, 12:28 AMHi Greg, can you send the
dockerg
Greg
10/03/2022, 12:56 AM@Aaron Pham @Bo the index URLs w/ a
--no-cachecontainerize👍 1