it confidently informed me that the conversion had been completed successfully and that the build completed successfully and all tests were passing successfully, even though the output from the build it had done immediately prior clearly told the LLM otherwise
JCTheDenthog on Hacker News
In the thread “Don't trust large context windows”, replying to this comment
Got in the way: Ignored CLI errors and false success claims.
… The dotnet CLI returned errors about trying to add the package references for Dapper, which Claude completely ignored while continuing to try and convert the ADO.NET calls to Dapper. And at the end it tried building the project, which of course failed, and then it confidently informed me that the conversion had been completed successfully and that the build completed successfully and all tests were passing successfully, even though the output from the build it had done immediately prior clearly told the LLM otherwise. A real human, despite being non-deterministic, would have caught the issue at multiple stages. …