The sm_120 shared-memory cliff: why FP8 KV cache crashes vLLM on workstation Blackwell

If you run vLLM with --kv-cache-dtype fp8 on a DeepSeek-family (MLA) model and your GPU is a GB10, an...

Raccontata dadev.to