it failed so miserably that its understanding of the content was below even my managers for whom this is only something they occasionally review
shoxidizer on Hacker News
In the thread “Samsung bans use of A.I. like ChatGPT for employees”, replying to this comment
Got in the way: Failed to explain standard differences and hallucinated movie scenes.
… I figured quizing it on reading comprehension would be a great task, given that it is a language based model and a skill seemingly in short supply amongst my coworkers and self. After confirming that the specifications of a standard I am implementing were within its knowledge, I tried to have it explain the difference between two parts and it failed so miserably that its understanding of the content was below even my managers for whom this is only something they occasionally review. Any attempt to correct it only resulted in it providing an apology and new misunderstandings. …