Mixed
The most significant improvement came from having agents commit their plan along with their work
ElFitz on Hacker News
In the thread “If you are asking for human attention, demonstrate human effort”, replying to this comment
Helped: Agents committing plans with work improved results.
Got in the way: Models consistently miss the same issues despite overlap.
… They never fully overlap, and yet they somehow usually all miss the same things. The most significant improvement came from having agents commit their plan along with their work. On the upside, it means I get to focus my reviews on different things.