Hallo, How can i apply custom chat template, whil...
# ask-for-help
s
Hallo, How can i apply custom chat template, while serving llm model? Does bentoml support peft inference? Anyidea have idea.