Mixed
I think LLMs are exceptionally good at reading and understanding code. If you guide them to do so, they're good at profiling and benchmarking
josephg on Hacker News
nearly as fast as those libraries
In the thread “There's no reason for software to be slow anymore”, replying to this comment
Helped: Benchmarking and optimizing with reference to existing hand-optimized code.
Got in the way: Generating novel optimizations for complex, already well-optimized codebases.
… (But still not faster than them.) My takeaway is this: I think LLMs are exceptionally good at reading and understanding code. If you guide them to do so, they're good at profiling and benchmarking. But it seems like they're not very good at coming up with novel optimisations. …