Hi team, I spoke with <@U0ACZGVT29G> about this is...
# questions
a
Hi team, I spoke with @important-yak-87889 about this issue, and he directed me to this channel. I'm working at FriendliAI, and our model catalog served on Model API is not currently displayed correctly in OpenHands when users select FriendliAI from the Basic mode dropdown. I'd like to resolve this issue before our co-hosting event on August. • Only two deprecated Llama models appear as of now • A workaround is available through the Advanced setup, but we want users (especially event attendees) to experience native OpenHands integration rather than being directed there. • I think the root cause is that OpenHands pulls its model list from LiteLLM repo, which we did not maintained so much. Fix PR is already posted but no progress so far. ◦ Model catalog update PR: github.com/BerriAI/litellm/pull/33501 Since this PR may not be merged before the event, I'd like to check with your team to see whether different solution is available. (e.g. pulling our model catalog directly from our
/v1/models
endpoint instead of LiteLLM) Would it be possible?
Also, as a separate issue, I wanted to check whether FriendliAI can be listed as a
VERIFIED_PROVIDER
in the OpenHands SDK. I don’t think this resolves the outdated model catalog issue, but it would still be great to have FriendliAI added as a verified provider through this partnership.
w
Pinged the PR! That is definitely the easiest way to get in
💯 1
👍 1
We would only add to VERIFIED after running an eval and adding to the OpenHands Index, which would probably take a while tbh
✅ 1
a
gratitude thank you The OpenHands team (led by Owen) and our team are discussing a co-hosted event on August 20. It would be great if FriendliAI could be listed as a
VERIFIED
around the event so we can promote it as part of the partnership.
Hmm, it looks like this still hasn’t received much attention. Could we also move forward with having FriendliAI added as a VERIFIED provider, if that resolves this catalog problem? We’re happy to cooperate with any required evaluations and provide the necessary information. @wooden-umbrella-84098