I assume this is running bentoml inside a docker container?
s
Smiral
11/26/2021, 9:33 AM
yes , basically pushing the image created by bentoml containerize to ecr and then using that in gpu enabled eks pods running gpu optimized aws ami
Smiral
11/26/2021, 9:34 AM
according to nvidia container toolkit, I need to have cuda drivers both on the base vm running these pods and the containers themselves too
Smiral
11/26/2021, 9:36 AM
check github.com/NVIDIA/nvidia-docker and because I'm running bentoml as base image I'm unable to use this runtime or install drivers in container , would be great if you could help me out