I recently switched to using GPT for Nelson and the security benchmarks I've been doing because Opus started refusing to do the work
SwellJoe on Hacker News
In the thread “The classifiers Anthropic puts in front of Fable are too zealous”
Helped: Switching to GPT for security benchmarks.
Got in the way: Fable and Opus refused to perform security auditing work.
I've found in my current work on a security auditing harness and benchmarks, both Fable and Opus are useless. I recently switched to using GPT for Nelson and the security benchmarks I've been doing because Opus started refusing to do the work. I guess I probably could also use GLM or DeepSeek or MiMo, and I'll probably do some experiments to see the shape of all of their guardrails in this area soon, now that I see it's more than one model that behaves this way (Gemini in Antigravity also refuses any security auditing task, even as simple as "find security bugs"). …