Mixed
the chances of it making parts of the response up is high enough that one has to invest significant amount to check and iterate over results
cycomanic on Hacker News
In the thread “Why DeepSeek is cheap at scale but expensive to run locally”
Got in the way: High hallucination rates and slow response times hindered quick iteration.
… While e.g. GPT-4o gives better results on average, the chances of it making parts of the response up is high enough that one has to invest significant amount to check and iterate over results. So the difference in effort is not much lower compared to the low parameter models. …