This message was deleted.
# announcements
s
This message was deleted.
a
I assume this is running bentoml inside a docker container?
s
yes , basically pushing the image created by bentoml containerize to ecr and then using that in gpu enabled eks pods running gpu optimized aws ami
according to nvidia container toolkit, I need to have cuda drivers both on the base vm running these pods and the containers themselves too
check github.com/NVIDIA/nvidia-docker and because I'm running bentoml as base image I'm unable to use this runtime or install drivers in container , would be great if you could help me out