straight-magician-16269
12/11/2025, 9:14 PMstraight-magician-16269
12/11/2025, 9:18 PMlimited-student-10747
12/11/2025, 9:19 PMstraight-magician-16269
12/11/2025, 9:21 PMstraight-magician-16269
12/11/2025, 9:41 PMstraight-magician-16269
12/11/2025, 9:43 PMlimited-student-10747
12/12/2025, 7:40 PMnutritious-balloon-65098
12/12/2025, 7:40 PMnutritious-balloon-65098
12/12/2025, 7:44 PMopenhands/usage/llms/local-llms.mdx
• ✅ All changes directly address the user's request
• ✅ No extraneous modifications
📊 Change Statistics:
• 1 file changed, 68 insertions(+), 25 deletions(-)
• Commit: bb4bc30 on branch openhands-workspace-44c7eih1
📝 Key Updates:
1. Model identifiers for both models throughout the document
2. Hardware requirements reflecting user's real-world testing (RTX 3060 12GB works with Qwen 3 Coder)
3. Context window recommendations appropriate for each model
4. Complete examples for all deployment methods (LM Studio, Ollama, SGLang, vLLM)
The changes are committed locally and ready. Would you like me to push these changes and create a pull request?
<sub>View full conversation</sub>nutritious-balloon-65098
12/12/2025, 7:49 PMollama pull qwen3-coder:30b and ollama pull devstral-small-2
• ✅ HuggingFace: Corrected paths to Qwen/Qwen3-Coder-30B-A3B-Instruct and mistralai/Devstral-Small-2-24B-Instruct-2512
• ✅ vLLM/SGLang: Updated all model identifiers throughout
📋 Final Changes Summary
File Modified: openhands/usage/llms/local-llms.mdx (69 insertions, 26 deletions)
Key Updates:
1. News section now features both Qwen3-Coder and Devstral Small 2
2. Hardware requirements based on real testing (12GB VRAM for Qwen3-Coder)
3. All deployment methods updated with correct model names and commands
4. Removed older models (OpenHands LM 32B v0.1, Devstral Small 2505)
5. Context window guidance included (22k minimum, 32k recommended)
Branch: update-local-llms-qwen3-devstral2
Pull Request: https://github.com/OpenHands/docs/pull/185 (Draft)
The documentation now accurately reflects the official model names and provides working commands verified against HuggingFace repositories and Ollama library listings.
<sub>View full conversation</sub>limited-student-10747
12/12/2025, 7:55 PMnutritious-balloon-65098
12/12/2025, 7:55 PMnutritious-balloon-65098
12/12/2025, 7:58 PMQwen3-Coder-30B-A3B-Instruct (30B MoE model)
• Hardware: 12GB VRAM minimum (tested on RTX 3060 12GB + 64GB RAM)
• Context: 22k minimum, 32k recommended
Simplified All Examples:
• LM Studio: Single download and configuration workflow
• Ollama: ollama pull qwen3-coder:30b
• SGLang/vLLM: Single model path Qwen/Qwen3-Coder-30B-A3B-Instruct
• Configuration: Streamlined Custom Model identifiers
📊 Final Stats
• File Modified: openhands/usage/llms/local-llms.mdx
• Changes: 26 insertions, 25 deletions
• Pull Request: #185 (Draft)
• Status: Changes pushed and ready for review
The documentation is now concise, accurate, and features the latest recommended local model for OpenHands!
<sub>View full conversation</sub>