This message was deleted.
# ask-for-helps
Slackbot
06/23/2023, 1:43 AMThis message was deleted.
a
Aaron Pham
06/23/2023, 1:51 AMyes what models are you thinking about
b
Bharath Krishna
06/23/2023, 2:49 AM@Aaron Pham its an NLP model.
Bharath Krishna
06/23/2023, 2:50 AMCould you also explain how can I host my own model via openllm? the guides are talking about the downloaded models
a
Aaron Pham
06/23/2023, 3:08 AMWhat architecture is this model?
b
Bharath Krishna
06/23/2023, 5:43 AMIts gpt3 architecture language model, decoder only
c
Chaoyu
06/28/2023, 4:56 AM@Bharath Krishna looks like you have your own custom model implementation as well?
b
Bharath Krishna
06/28/2023, 4:57 AMYes @Chaoyu
Bharath Krishna
06/28/2023, 4:57 AMIt’s not supported right?
c
Chaoyu
06/28/2023, 5:05 AMyea it’s impossible to support if it’s completely custom code 😅 but that’s where you can use BentoML
Chaoyu
06/28/2023, 5:06 AMyou may need to handle some of the inference optimization yourself as well
Chaoyu
06/28/2023, 5:06 AMthere’s no free lunch 😄. you are using a custom model after all, which gives you more power but it won’t be compatible with all the other tools
b
Bharath Krishna
06/28/2023, 6:15 AMhmm, that seems yummy, let me try 😛