Hey I m trying to create a bento with cuda + conda environme BentoML #ask-for-help

Hey, I'm trying to create a bento with cuda + cond...

Shani Rosen

09/16/2024, 1:26 PM

Hey, I'm trying to create a bento with cuda + conda environment. This is how I configured it:

Copy code

conda:
  environment_yml: "./environment.yaml"
docker:
  distro: debian
  python_version: "3.10"
  dockerfile_template: ./Dockerfile.template.jinja
  cuda_version: "11.8.0"

But when I run containerize, seems like the nvidia-cuda docker image is what's used and there is conda installation or anything related to the env yaml inside the docker container (and also all of my dependencies in the env yaml were not installed).

bash: conda: command not found

(inside the container) Anyone knows how to fix this? using bentoml 1.3.5

Chaoyu

09/16/2024, 5:16 PM

could you share the dockerfile template?

Chaoyu

09/16/2024, 5:16 PM

or try it again without the template?

Shani Rosen

09/17/2024, 9:04 AM

I tried again without the template and it happened again. Inside the docker there is no conda installed, and there is python3.10 without any of the packages under the yaml

👀 1

Shani Rosen

09/17/2024, 9:05 AM

Copy code

> [base-container  1/14] FROM <http://docker.io/nvidia/cuda:12.1.1-cudnn8-runtime-ubuntu20.04@sha256:4d0748e17319c7afde812a57943b9febe9c20237a7e168f9d18224034dff9d14|docker.io/nvidia/cuda:12.1.1-cudnn8-runtime-ubuntu20.04@sha256:4d0748e17319c7afde812a57943b9febe9c20237a7e168f9d18224034dff9d14>                             0.0s
 => [internal] load build context                                                                                                                                                           0.0s
 => => transferring context: 23.18kB                                                                                                                                                        0.0s
 => CACHED [base-container  2/14] RUN rm -f /etc/apt/apt.conf.d/docker-clean; echo 'Binary::apt::APT::Keep-Downloaded-Packages "true";' > /etc/apt/apt.conf.d/keep-cache                    0.0s
 => CACHED [base-container  3/14] RUN --mount=type=cache,target=/var/lib/apt --mount=type=cache,target=/var/cache/apt set -eux &&     apt-get update -y &&     apt-get install -q -y --no-  0.0s
 => CACHED [base-container  4/14] RUN curl -LO <https://astral.sh/uv/install.sh> &&     sh install.sh && rm install.sh && mv $HOME/.cargo/bin/uv /usr/local/bin/                              0.0s
 => CACHED [base-container  5/14] RUN --mount=type=cache,target=/var/lib/apt --mount=type=cache,target=/var/cache/apt     set -eux &&     apt-get install -y --no-install-recommends --all  0.0s
 => CACHED [base-container  6/14] RUN ln -sf /usr/bin/python3.10 /usr/bin/python3 &&     ln -sf /usr/bin/pip3.10 /usr/bin/pip3

Shani Rosen

09/18/2024, 6:06 AM

Hey, any updates on this?

Open in Slack

Previous Next