I was running at 124k tokens earlier and it was still just buzzing along with no issues or fatigue
kamranjon on Hacker News
124k tokens
In the thread “A few words on DS4”
Helped: Long context capabilities and MoE architecture speed.
… I actually have it running on my personal macbook m4 max with 128gb of ram and I am running the server to share it through tailscale with my work laptop and just have pi running there. The long context reasoning is something I haven't even seen in frontier models - I was running at 124k tokens earlier and it was still just buzzing along with no issues or fatigue. I am amazed at how well it works, I'm using it right now for some pretty complex frontend work, and it is much much faster than, for example running a dense 27b or 31b model (like qwen or gemma) for me (The benefits of MoE) - but the long context capabilities have been what have been absolutely flooring me. …