All 4,799 reports

YesClaude · 8 Mar 2026

I discovered that AI writes tests that mirror the code, not validate that the implementation is correct

ccosky on Hacker News

In the thread “How Gen AI Is Changing the Way We Write Code”

Helped: Custom skill validating test structure against method names and conditions.

Got in the way: AI initially wrote tests that mirrored code rather than validating correctness.

… Yes, I agree, it is good at coming up with lots of scenarios. But after switching to AI-generated unit tests, I discovered that AI writes tests that mirror the code, not validate that the implementation is correct. So I have AI write the unit test with a particular pattern in the method name: …