This message was deleted.

@larme (shenyang) can you provide some insight for this?

Hi Sato, do you use openllm? you can use

openllm start google/flan-t5-base --backend=pt

to start t5 model server. backend=vllm not working for now because vllm does not support t5 yet

@larme (shenyang) I see, I understand. Thanks for your answer.