Mixed
I've seen it completely conjure up bogus solutions as well
taftster on Hacker News
In the thread “Researchers seeing little evidence of benefit from co pilots”
Helped: Finding bugs and offering insights during code reviews.
Got in the way: Fabricating legitimate-looking but bogus configuration changes.
… There would be too much going back and verifying that it got it right. And additionally, I've seen it completely conjure up bogus solutions as well. For example, I've had copilot offer a configuration change that was completely fabricated; it looked legitimate enough that a senior systems engineer attempted to install/deliver the "fix" it offered when the suggestion was completely made up. …