All 4,799 reports

NoLlama, Qwen · 8 Mar 2026

trying to run the MoE versions to get decent performance just didn't work with Ollama

KronisLV on Hacker News

In the thread “How to run Qwen 3.5 locally”

Got in the way: Ollama failed to run MoE models on dual L4 cards.

I had an annoying issue in a setup with two Nvidia L4 cards where trying to run the MoE versions to get decent performance just didn't work with Ollama, seems the same as these: https://github.com/ollama/ollama/issues/14419 …