Hello,
I'm having a problem with model billing/routing that I can't seem to resolve, even though my configuration appears to be correct.
My configuration (Bot Settings > LLM options):
All models are set to Gemini 2.5 Flash-Lite:
Default Fast LLM: Gemini 2.5 Flash-Lite
Default Best LLM: Gemini 2.5 Flash-Lite
Autonomous Language Model: Gemini 2.5 Flash-Lite
RAG Language Model: Gemini 2.5 Flash-Lite
Fallback LLM: Gemini 2.5 Flash-Lite
My Autonomous Node also has āOverride default modelā and āOverride default RAG modelā enabled for Gemini 2.5 Flash-Lite.
The problem:
Despite this, my production logs show the following for every message:
Model: Openai:openai ⢠tokens in/out=8537/165 ⢠spend $0.0172
The bot consistently bills via OpenAI, never via Gemini, at a cost of approximately $0.017ā$0.02 per messageāwhich corresponds to the rate for a premium OpenAI model, not Flash-Lite.
What Iāve already tested:
Reposted multiple times after each change
Tested in new conversations each time
Disabled/re-enabled node overrides: no effect, still OpenAI
Disabled āUse Cognitive V2ā: the bot stopped responding entirely (108s timeout, 0 tokens charged), so I re-enabled it
My questions:
Why is the bot billing through OpenAI when none of my settings point to OpenAI?
Is this related to Cognitive V2? How can I force the use of Gemini 2.5 Flash-Lite while keeping Cognitive V2 active (since itās necessary for the bot to function)?
Iām also noticing response times that are sometimes very long (up to 58 seconds). Is this related?
Thank you in advance for your help.