Why Ollama runs on CPU after an update: the missing sm_86 CUDA kernels
You update Ollama, pull the model you use every day, and everything gets slower. Not broken, not erroring. Just slow. ollama ps says something like 12% CPU / 88% GPU, so you shrug and carry on. Then you open nvidia-smi mid-generation and see Ollama using 0 MiB of VRAM.
It's been running on CPU this whole time. Nobody told you.
This is what's happening to a lot of RTX 30-series owners after Ollama 0.32.14, and to people with A40/A6000/A10 cards too.
The symptom







