Mixed
At least until you are halfway through something and you realize Claude didn’t listen when you wrote 5 times in capital letters NEVER MAKE UP DATA YOU ARE NOT ALLOWED TO USE np.random IN PLACE OF ACTUAL DATA
mnky9800n on Hacker News
In the thread “Why the push for Agentic when models can barely follow a simple instruction?”
Helped: Writing boilerplate code for different datasets.
Got in the way: Model ignored instructions and fabricated data using np.random.
… So coding agents solve a lot of that. At least until you are halfway through something and you realize Claude didn’t listen when you wrote 5 times in capital letters NEVER MAKE UP DATA YOU ARE NOT ALLOWED TO USE np.random IN PLACE OF ACTUAL DATA. It’s all kind of wild because when it works it’s great and when it doesnt there’s no failure state. …