Mixed
I am noticing some really inconsistent behaviours in 0125-preview where it responds inconsistently for certain problems
anshumankmr on Hacker News
In the thread “GPT-4 Turbo with Vision is a step backwards for coding”, replying to this comment
Helped: Switching to 0125-preview resolved initial generation failures.
Got in the way: Inconsistent responses to detailed prompts in 0125-preview.
… We have been using that for whenever we have code generation related tasks unless we are doing FAQ stuff (where GPT 3.5 Turbo was good enough). However, off late, I am noticing some really inconsistent behaviours in 0125-preview where it responds inconsistently for certain problems, ie one time it works with a detailed prompt and other time it doesn't. I know these models are predicting the next most likely token which is not always deterministic. …