Yes
But by pointing it at a real working environment and actively encouraging it to get its hands dirty, it found the actual solution rapidly
AussieWog93 on Hacker News
In the thread “Ask HN: What was your "oh shit" moment with GenAI?”, replying to this comment
Helped: Explicitly instructing it to test against real data and working environment.
Got in the way: Providing wrong information twice initially.
… Had I simply described the issue and asked it to think up a solution it likely would have just navel-gazed and then come up with a wrong solution. But by pointing it at a real working environment and actively encouraging it to get its hands dirty, it found the actual solution rapidly - in spite of the fact that I gave it wrong information twice.