Mixed
I am finding that for complex tasks, Claude's quality of output varies _tremendously_ with repeated runs of the same model and prompt
bityard on Hacker News
95% of the first run in terms of quality
In the thread “Measuring Claude 4.7's tokenizer costs”, replying to this comment
Helped: Writing a detailed plain English spec before asking for the plan.
Got in the way: Inconsistent output quality across repeated runs of the same prompt.
… So I'm free to do low-stakes experiments on Claude without having to worry about hitting my monthly usage limit. I am finding that for complex tasks, Claude's quality of output varies _tremendously_ with repeated runs of the same model and prompt. For example, last week I wrote up (with my own brain and keyboard) a somewhat detailed plain english spec of a work-related productivity app that I've always wanted but never had the time to write. …