Mixed
I would spend so much more on LLMs for batch workloads if they could do them more reliably…
weitendorf on Hacker News
In the thread “Local Qwen isn't a worse Opus, it's a different tool”, replying to this comment
Helped: Agentic loops with self-evaluation structures for specific domains.
Got in the way: Predictability and stability of outputs across runs.
… I wish this kind of “stability” in output was more emphasized in their training so they’d be predictable. I assume it’s hard to do without overfitting or breaking the explore-exploit loop but also, I would spend so much more on LLMs for batch workloads if they could do them more reliably…