While I'm having much more success getting OpenHan...
# questions
s
While I'm having much more success getting OpenHands started on programming apps of different kinds, I'm still running into issues where it continually loops for hours and hours and eventually gives up and spits out: `Timeout: litellm.Timeout: APITimeoutError - Request timed out. Error_str: Request timed out.`Does this sound like exhausting the context window? and if so, is there a way to continue developing past the first few hundred LOC?
c
A Timeout can be just that the LLM API didn't respond, it can happen randomly. If it was context window, OpenHands has a mechanism to condense after a number of events. Was the condenser enabled in your run?
I don't see in the log any "condensation event", so it didn't happen
A random timeout shouldn't matter, you could try to just continue, as I think you did
I see your LLM was Qwen-3-coder 30b
We have evaluated a Qwen3-coder 480b, and it seemed very good on software tasks: https://docs.google.com/spreadsheets/d/1wOUdFCMyY6Nt0AIqF705KN4JKOWgeI4wUGUP60krXXs/edit?gid=0#gid=0
its bigger brother 😊
s
yeah I can certainly try 480b,, but im only on 12gb VRAM. I had it happen again on my most recent attempt and when i asked it to try again it ran the condenser immediately
I can try to clear a bunch of HD space for 480b and give it a try overnight but I don't have particularly high hopes lol, LM Studio says likely too large to run. It's a shame there is nothing in between. Right now openhands is just spinning in circles trying to load a python module it created and failing every time with ModuleNotFound errors :(
And now its failing with context window overflow so I'm even more skeptical that a larger model will have better results since my 12gb VRAM will probably provide a very small context-window
c
when i asked it to try again it ran the condenser immediately
Ah, sounds like you might be right, it timed out when sending and processing half the history, trying to summarize it
s
I played around with the settings of the 30b and got it to load with the full 2500k contexxt window so fingers crossed 🙂
250k* sorry mechanical kbd
I had to take the KV Cache off VRAM but glad I can at least try it