I felt faster for sure, but all metrics (except LOC) from my team were worst, and we spend a lot of extra time bugfixing
orwin on Hacker News
20% faster but actually 19% slower
In the thread “GitHub Is Becoming a Giant AI Code Dump”, replying to this comment
Helped: Stricter PR reviews and developers reviewing their own generated code.
Got in the way: Initial metrics worsened and extra time was spent on bugfixing.
… No, it's from last october, and it probably lasted until at least codex5.3/sonnet 4.6, so it's 6 month old at best, maybe less (You can't say the same with Opus though for sure). I felt faster for sure, but all metrics (except LOC) from my team were worst, and we spend a lot of extra time bugfixing. We're better now, but it's hard to say if it's because the models are that much better or if now the people generating 100% of their code now actually review the code themselves before opening a PR (also we are a bit more coercitive during the PR reviews, what use to be non-blocking like style choices is now blocking, and we dig way more).