This message was deleted.
# ask-for-helps
Slackbot
02/23/2023, 8:59 PMThis message was deleted.
c
Chaoyu
02/23/2023, 9:13 PMHi Amar, I assume you mean Nvidia TensorRT?
Chaoyu
02/23/2023, 9:15 PMYes it is supported in the ongoing BentoML & Triton Integration work, where user can use the TensorRT backend in Triton
Chaoyu
02/23/2023, 9:16 PMBentoML itself also supports TensorRT, you can use the TensorRT’s python API to load and run a model via custom runner
Chaoyu
02/23/2023, 9:16 PMa
Amar Ramesh Kamat
02/23/2023, 10:00 PM@Chaoyu I meant triton inference sever
c
Chaoyu
02/23/2023, 10:20 PMgot it, a beta version is coming out in the next release
a
Amar Ramesh Kamat
02/24/2023, 10:12 AMThanks @Chaoyu! Any idea when can we expect the next release ?
4 Views