Yes
it's really easy to make quick gains this way and save your users from bugs
paddy_m on Hacker News
In the thread “Why eval startups fail (2025)”
Helped: Testing different prompting and API surfaces to shape LLM behavior.
… The code is complex, and I want to shape my APIs such that LLMs do a better job of quickly getting to the right answer. So I test different prompting and api surfaces, it's really easy to make quick gains this way and save your users from bugs. In this paradigm, I'm explicitly not testing different models, and I'm very interested to see how lesser models do with my software. …