All 4,799 reports

NoGPT · 25 Mar 2023

When I pushed it to implement specific details it completely fell apart and started hallucinating

gateorade on Hacker News

In the thread “GPT-4 performs significantly worse on coding problems not in its training data”

Got in the way: Hallucinated implementation details and refused to write full code for niche problem.

… If it was actually capable of something close to reasoning it should have been able to write an implementation, but when it actually started writing code it was reluctant to write more than a skeleton. When I pushed it to implement specific details it completely fell apart and started hallucinating. When I gave it specific information about what it was doing wrong it acknowledged that it made a mistake and simply gave me a new equally wrong hallucination. …