in the last week or two, both models started putting placeholder comments
TeMPOraL on Hacker News
In the thread “Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?”, replying to this comment
Got in the way: Models started using placeholder comments and ignoring instructions for complete solutions.
… (API) through TypingMind also gets dumber if you enable web search (which, in the background, adds some substantial amount of instructions to the system prompt) -- however, - GPT-4 via Azure (at work) and via OpenAI API (personal) both started to get lazy on me; before about 2-3 weeks ago, they would happily print and reprint large blocks of code for me; in the last week or two, both models started putting placeholder comments; this I noticed, because I use the same system prompt for coding tasks, and the first time the model ignored my instructions to provide a complete solution, opting to add placeholder comments instead, was quite... startling. …