However, its very much still in the "tinkerer" phase where it's overall a net productivity loss (and massive financial loss) vs just paying $20/mo for a hosted frontier model
garethsprice on Hacker News
~80t/s for gpt-oss-20B
In the thread “Ask HN: Who uses open LLMs and coding assistants locally? Share setup and laptop”
Helped: Fast responses for small one-off questions and scripts
Got in the way: Multi-step agentic work and overall productivity
… It's remarkable how fast things are moving in the local LLM world, right now the Qwen/gpt-oss models "feel" like gpt-3.5-turbo did a couple of years back which is remarkable given how groundbreaking (and expensive to train) 3.5 was and now you can get similar results on sub-$2k consumer hardware. However, its very much still in the "tinkerer" phase where it's overall a net productivity loss (and massive financial loss) vs just paying $20/mo for a hosted frontier model.