All 4,799 reports

YesClaude · 23 Sep 2026

I was surprised how much worse Astra did on correctness; I stopped testing with it

roflc0ptic on Hacker News

About $24 for 10 PRs

In the thread “Claude Opus 5.5”, replying to this comment

Helped: Back testing against PR comments

Got in the way: Astra had worse correctness

… About $24 for 10 PRs. I was surprised how much worse Astra did on correctness; I stopped testing with it. Gonna try sol and Luna but low confidence