Feature Idea: Adding LLM Provider instead of addin...
# proj-agent-canvas
h
Feature Idea: Adding LLM Provider instead of adding individual profiles github.com/OpenHands/agent-canvas/issues/1657
thinky spin 1
m
What is the difference of what we are already doing?
h
Right now I need to add a LLM profile for each model. I'd like to instead add my API one time and get all the models available from that vendor. For something like OpenHands that could be a lot so we might need to add a default set like the ones we show docs.openhands.dev/openhands/usage/llms/llms. This would mean with one input a user can now access 8+ models and their single API key.
It could technically iterate through and add an LLM profile for each recommended or available model
m
Ah ok. You want to fix the key (or reuse) by provider. Makes sense
👍 1
c
Yes, we should save keys per provider at least. I left a little comment on this.