All 4,799 reports

MixedClaude Code · 7 May 2026

It will generate a test that does not actually test what it "thinks" it tests

linuxhansl on Hacker News

In the thread “Vibe coding and agentic engineering are getting closer than I'd like”

Helped: Offloads grunt work and helps game out design decisions.

Got in the way: Generates incorrect tests and confidently breaks existing functionality.

… I work on database optimizers and other database related stuff, and I can assure Claude Code - with all the highest settings - does make mistakes. It will generate a test that does not actually test what it "thinks" it tests. It will confidently break stuff. …