Mixed
It produces code that looks ok most of the time, but I have seen it lose track of key details, misinterpret requisites and even ignore them sometimes
otikik on Hacker News
at least once per day
In the thread “A sufficiently detailed spec is code”, replying to this comment
Helped: Mechanical tasks and quick exploration of other people's code.
Got in the way: Losing track of key details and misinterpreting or ignoring requirements.
… It is far from being able to reliably produce the code that we need for production. It produces code that looks ok most of the time, but I have seen it lose track of key details, misinterpret requisites and even ignore them sometimes - "on purpose", as in it writing something like "let's not do that requirement, it's not necessary". This kind of thing happens at least once per day to me, maybe more. …