No
It was shockingly bad, as in even attempting to make invalid moves
unclebucknasty on Hacker News
In the thread “Is GPT-4 a good data analyst? (2023)”, replying to this comment
Got in the way: Lack of understanding, invalid moves, and confident wrongness.
… When ChatGPT 4 first came out I spent a couple of hours putting together a chess game using ChatGPT as the engine. It was shockingly bad, as in even attempting to make invalid moves. I get it: it's not tuned for that purpose, and its chess training corpus could probably be expanded to improve it as well. …