I just end up with thousands more lines of unit and integration tests that then take even more time to analyze
fulladder on Hacker News
In the thread “Vibecoding #2”, replying to this comment
Helped: Test-first approach (TDD) with hand-written testbenches for silicon design.
Got in the way: Reviewing huge generated PRs and analyzing thousands of AI-written tests.
… Don't get me wrong, overall I really like having AI in my workflow and have gotten many benefits. But even when I ask it to check its own work by writing test cases to prove that properties A, B and C hold, I just end up with thousands more lines of unit and integration tests that then take even more time to analyze -- like, what exactly is being tested here?, are the properties these tests purport to prove even the properties that I care about and asked the agent for in the first place, etc. I have tried (with at least modest success) to use a second or third agent to review the work of the original coding agent(s), but my general finding has been that there is no …