Mixed
6 months later, it was impossible to replicate
muzani on Hacker News
In the thread “Ask HN: Has degradation in the quality of ChatGPT and Claude been proven?”
Helped: GPT-4 previously found errors from opaque messages.
Got in the way: GPT-4 degradation; Claude 3.5 wrong assumptions and strictness.
… Basically, I took a screenshot of a frustrating error, gave it some code, and it would find the error from an opaque message. 6 months later, it was impossible to replicate. Seems foolproof evidence to me. …