there are some areas of my work that reliably trip up both models and I get better mileage out of writing code the old fashioned way
thot_experiment on Hacker News
In the thread “Local AI needs to be the norm”, replying to this comment
Helped: Running models in parallel on complex DSP and shader projects.
Got in the way: Models stumble on hard tasks; writing code manually is better.
… is by doing it and measuring across many trials. I've been running Opus 4.7 in Claude Code and Gemma 4 31b in parallel on projects for hours a day this past week, Opus 4.7 is definitely better, but for many things they are roughly equivalent, there are some things on the edge that are just up to chance, and either model may stumble across the solution, and there are some areas of my work that reliably trip up both models and I get better mileage out of writing code the old fashioned way. I understand that I'm just one data point, but I'm not writing CRUD apps here, I'm doing DSPs and weird color math in shaders, I don't think any of it is hard, and the stuff that I think is hard none of the models are good at yet, but idk, they just don't seem that extremely disparate from one another. …