All 4,799 reports

NoGPT · 5 Sep 2023

Using the latest version (0613), it drops to 85%

rafaelero on Hacker News

95% accuracy

In the thread “ChatGPT can get worse over time, Stanford study finds”

Got in the way: Latest version dropped accuracy to 85% compared to original GPT-4.

The original GPT-4 gets 95% accuracy in my own benchmark (a multiple choice questions dataset I have built for a client in law-related subjects). Using the latest version (0613), it drops to 85%. So yeah, it is also my experience that the performance has degraded.