The error rate is still arguably lower than mine, though I work in a very well known and represented domain
KronisLV on Hacker News
8 million tokens
In the thread “Anthropic says OpenClaw-style Claude CLI usage is allowed again”, replying to this comment
Helped: Sub-agent support and low error rate in webdev/DevOps tasks.
Got in the way: Service instability, tokenizer changes, and subscription payment model.
… At the same time, in practice I've only seen it do stupid things across 8 million tokens about 5 times (confusing user/assistant roles, not reading files that should be obvious for a given use case, and picking trivially wrong/stupid solutions when planning things), alongside another 4 times that tests/my ProjectLint tool caught that I would have missed. The error rate is still arguably lower than mine, though I work in a very well known and represented domain (webdev with a bunch of DevOps and also some ML stuff, and integration with various APIs etc.). At the same time, the 85 EUR they gave to me for free has been enough to weather the instability in regards to pricing changes and peak usage. …