Deploying DeepSeek R1 Reasoning LLM Using SGLang

DeepSeek R1 is a first-generation reasoning model tuned for math, coding, and logical reasoning — reinforcement learning with a cold-start phase for readability and coherence, minimizing repetition and language mixing. This guide deploys it via SGLang in a ROCm-supported container on an AMD Instinct MI300X GPU server, then verifies inference over HTTP.

Prerequisites: access to an AMD Instinct MI300X GPU instance (large VRAM is required for this model's size).

Deploy DeepSeek R1

1. Install the Hugging Face CLI and start the model download in the background — it's large, so kick it off early and continue with the next steps while it completes:

$ pip install huggingface_hub[cli]

Deploying DeepSeek R1 Reasoning LLM Using SGLang

Related reading

Deploying DeepSeek V3 (LLM) Using SGLang

DeepSeek rival MiniMax says its first AI reasoning model halves compute of R1

Qwen3 vs DeepSeek R1: Which Open-Source Reasoning Model Should You Use in 2026?

DeepSeek’s updated R1 AI model matches Google, Anthropic in coding benchmark

Reasoning Models Explained: o1, DeepSeek-R1 & Beyond

DeepSeek API Complete Guide: Setup, Pricing, and Best Practices