Yes
it uncovered some warts I didn’t catch by testing it myself
bunderbunder on Hacker News
In the thread “Ephemeral Testing”
Helped: Using LLM to re-implement notebooks to find edge cases.
… I was designing a DSL to help make a colleague’s work easier, and I tested it by having a coding agent re-implement some of their notebooks using a draft of the DSL. The LLM output was a decent enough approximation of “typical” use, and it uncovered some warts I didn’t catch by testing it myself. As its designer, I simply wouldn’t have thought to try using it in some of the ways the LLM-generated code did.