Are models being switched mid-conversation on the ...
# openhands-cloud
c
Are models being switched mid-conversation on the Cloud? Is it intended behavior? 5e1c2e15da9842d196ae29e44fc45f36
c
cc @red-autumn-42356 @quick-window-91705 đź‘€
r
they shouldnt be... model assignment should persist through a convo
c
To note, this is after a session restore
The above is written by OH-agent, my “secretary”, who peaked at all trajectory via API, and • found Sonnet-4 in the newest toolcall metadata • and GPT-5 in all previous toolcall metadata. I set it to check trajectory it when I actually saw myself that the model is Sonnet-4 and felt that’s weird, because I was sure the model in that conversation used to be GPT-5.
r
there was only one model switch? gpt-5 -> sonnet 4?
c
I think so? We can retrieve the trajectory file
The agent committed the .json and some summary it made
Does the Cloud code actually force the model assignment to persist? OpenHands doesn’t.
But that doesn’t make it less weird, because … I don’t think I changed anything, and it’s the Cloud code that changes / chooses models 🤔
Another conversation where the model was switched: 4c2948df77424deaa23b6a09ada34259
In this case, it was 2h old, and FWIW I don't think the runtime stopped completely in this time
I didn't ask my secretary about this one, but it's obvious between Sonnet and GPT-5
Actually, I made a new secretary - ended up with GPT-5, who says:
• Full trajectory: I downloaded all events and saved them to cache/trajectories/conversation_4c2948df77424deaa23b6a09ada34259_events.json for offline analysis.
• Model findings:
• Unique models observed:
▪︎ litellm_proxy/claude-sonnet-4-20250514 (first seen at event 9, last at 383)
â—¦ gpt-5-2025-08-07 (first seen at 392, last at 434)
â—¦ Prefix discrepancy in this conversation: Claude shows the litellm_proxy/ prefix, GPT-5 does not.
• Comparison to prior model-switch note in the MD (Conversation #23):
â—¦ There, both models were recorded with the litellm_proxy/ prefix (e.g., litellm_proxy/gpt-5-2025-08-07 and litellm_proxy/claude-sonnet-4-20250514).
â—¦ So yes: Previously both had the prefix; in the new conversation only Claude has the prefix while GPT-5 appears without it.