Mixed
it regularly confidently tells me that some optimization will cut training time down to 3 hours
antonvs on Hacker News
training time down to 3 hours
In the thread “What happened after 2k people tried to hack my AI assistant”, replying to this comment
Helped: Helpful with actual technical changes needed for the pipeline.
Got in the way: Confidently predicts 3h training time but reality is 11h with reduced accuracy.
Gemini is often terrible with that sort of prediction. I've been optimizing an ML training pipeline using Gemini, and it regularly confidently tells me that some optimization will cut training time down to 3 hours. The reality: nothing has run in less than 11 hours so far, and even that's only at the cost of reduced model accuracy. …