The tests can definitely be incorrect, and are often incorrect
seanmcdirmid on Hacker News
In the thread “Case study: Creative math – How AI fakes proofs”, replying to this comment
Helped: Instructing AI to assume tests might be wrong to improve code quality.
Got in the way: GeminiCLI lacks sub-agents; difficult to control conversation context.
… I hope I can release what I'm doing eventually, although it isn't a key piece of AI tech (just a way to orchestrate the pipeline to make sure that AI gets different context for different parts of the pipeline steps, it might be obsolete after we get better support for orchestrating dev work in GeminiCLI or other dev-oriented AI front ends). The tests can definitely be incorrect, and are often incorrect. You have to tell the AI that consider that the tests might be wrong, not the implementation, and it will generally take a closer look at things. …