Mixed
I ran Opus 4.6 and Codex 5.3 (xhigh) on it and both came back with passable answers, but I was able to double the score doing it by hand
actsasbuffoon on Hacker News
double the score
In the thread “Gemini 3 Deep Think drew me a good SVG of a pelican riding a bicycle”, replying to this comment
Got in the way: Spatial reasoning tasks where manual effort outperformed AI output.
… I’m actually building a new code exercise for my company right now where the candidate is allowed to use any AI they want, but it involves spatial reasoning. I ran Opus 4.6 and Codex 5.3 (xhigh) on it and both came back with passable answers, but I was able to double the score doing it by hand. It’ll be interesting to see what happens if a candidate ever shows up and wants to use Deep Think. …