This message was deleted.
# announcementss
Slackbot
02/18/2022, 11:00 AMThis message was deleted.
c
Chaoyu
02/19/2022, 1:04 AMHi @seraus - do you mind tell us a bit more about your use case? Is this runner only gonna be used once? Is the goal to serve many models on the same server and only one model is used at a time, so you don’t want to keep all the models in memory?
s
seraus
02/22/2022, 8:49 AMHello Chaoyu, please to meet you and thanks for your answer.
seraus
02/22/2022, 8:52 AMYes, our goal is to serve many random forrest models (60) with the same service and we don't want to load all models in memory at start, peraphs mantaining the most recents in memory in a sort of "cache"
seraus
02/22/2022, 8:56 AMI took a look at bentoml's code and it seems that the model is loaded to memory when doing .run() on a runner. Therefore I was asking if one can do a sort of unload or shutdown of a runner, Thanks