This message was deleted.

yes - many more are in the OpenLLM discord channel as well. There are still some rough edges with the user experience - e.g. some of the default argument may not work on CPU and needs to tweak the CLI arguments to get it working for some of the models. Feel free to ask any questions or issues you ran into here.

You could join https://l.bentoml.com/join-openllm-discord and meet some others that is actively using OpenLLM in the discord