Yes
Qwen3.6-27B scores only 4% lower for pass@1, n=250 compared to Opus-4.8
spmurrayzzz on Hacker News
Qwen3.6-27B scores only 4% lower for pass@1, n=250 compared to Opus-4.8
In the thread “Qwen 3.8 27B”, replying to this comment
Helped: Internal eval on embedded systems repos with non-trivial issues.
… We have an internal eval that measures performance on tasks for a handful of embedded systems repos for our mmWave radios (mostly Rust, some C for microcontroller stuff). Qwen3.6-27B scores only 4% lower for pass@1, n=250 compared to Opus-4.8. For the labeled dataset, the average PR size they're being measured against is around 1.5k SLOC. …