This message was deleted.

Hi Karl, CUDA 12 is not currently supported directly out of the box with the

cuda_version

option, but you should be able to use the

system_packages

,

setup_script

or

cuda

packages to install required dependencies

I have not been successful doing that. The further I got was using a proper base image that have the proper driver/dependencies, however my setup_script doesn’t seem to get executed early enough in the build process to properly install python and pip.

Could you help check if the setup.py file was under the build_context? (the directory where you run

bentoml build

)