Slackbot
12/04/2022, 5:28 AMBenjamin Tan
12/04/2022, 6:34 AMAaron Pham
12/04/2022, 7:56 AMSudeep Ghimire
12/04/2022, 7:42 PMNo CUDA runtime is found, using CUDA_HOME='/usr/local/cuda'
. To provide further details, we have some strict restrictions on using python 3.7.10 and hence had to follow the docker template path. Hence the docker configuration in bentfile.yml is
docker:
base_image: nvidia/cuda:11.4.0-base
dockerfile_template: "./Dockerfile.template"
And we do install all necessary packages in the docker template. Specified base image has cuda drivers installed and the steps in the docker template is same as one of our current running environment (one without bentoml). Quite stuck on the container not detecting available gpu.Benjamin Tan
12/05/2022, 2:04 AMCUDA_HOME
is not setBenjamin Tan
12/05/2022, 3:00 AMbentofile.yaml
like:
docker:
distro: debian
python_version: "3.7.10"
cuda_version: "11.4.0"
Benjamin Tan
12/05/2022, 3:00 AMBenjamin Tan
12/05/2022, 3:01 AMAaron Pham
12/05/2022, 6:53 AM