Hello, what would be the best model to run with 48gb vram. Qwen3.6 35B A3B is substantially worse than even cheapest openai models.
s
swift-judge-9879
09/09/2026, 4:04 PM
I have had a lot of success with qwen3.8-27b UD-Q4_K_XL running 250k context taking up a total of ~37GB reported vRAM usage in nvidia-smi
l
limited-student-10747
09/10/2026, 11:48 AM
Yeah, I think 3.8 27B may be the best bet now
b
blue-sundown-4488
09/10/2026, 11:50 AM
I'm using Qwen/Qwen3.8-27B-FP8 on medium reasoning effort and I'm very happy with that. The 35B is a MoE with only 3B active parameters. The 27B is a dense model, so it's slower, but smarter with its 27B active parameters.