Mixed
I recently started to track how often Github Copilot gives me a bad or wrong answer, and it's at least 50% of the time
safety1st on Hacker News
at least 50% of the time
In the thread “Study mode”, replying to this comment
Helped: Polite interaction and ability to correct the model with partial answers.
Got in the way: High frequency of bad or wrong answers from the tool.
… The second, related issue I have is that we are starting to see evidence that the LLM inspires more trust than it deserves due to its humanlike interface. I recently started to track how often Github Copilot gives me a bad or wrong answer, and it's at least 50% of the time. It "feels" great though because I can tell it that it's wrong, give it half the answer, and then it often completes the rest and is very polite and nice in the process. …