Hey folks π β I just put up a PR I'd love some eyes on:
Pluggable in-chat LLM routing β
https://github.com/apache/flink-agents/pull/852
The idea: instead of pinning an agent to one chat model, you point it at a little router that picks the model per request and delegates. It's a drop-in CHAT_MODEL, so nothing in the runtime or your agent definition changes. Comes with two strategies out of the box β simple keyword/rule routing and an "ask a cheap judge model" one β plus optional fallback and caching, and you can drop in your own (ML included) without touching the framework.
Part two is also in the works: routing records to different agents based on their content. More on that soon.
Would really appreciate review on part one. Thanks!