Yes
It found serious security issues that had been in productions for years that humans never found
jml78 on Hacker News
In the thread “Show HN: We post-trained a model that pen tests instead of refusing”, replying to this comment
Helped: Adding context proving ownership to enable red team attempts.
Got in the way: Fable refused to function with their harness.
… It found tons of stuff that was not found with just scanning the code. It found serious security issues that had been in productions for years that humans never found. They weren’t things that were accessible externally but serious enough that we are thrilled to have these tools. …