At RAISE Summit 2026, SambaNova is showing the next preview of premium inference: SambaRack SN50 running the fastest MiniMax M2.7 in a heterogeneous, disaggregated inference setup with one NVIDIA H200 rack using four GPUs for prefill and one SambaRack SN50 with 16 RDU chips for decode. The demo builds on the COMPUTEX blueprint we showed live with NVIDIA B200 GPUs for prefill and SambaNova SN40 RDUs for decode, and moves that architecture forward with SN50 for agentic inference.
As benchmarked by Artificial Analysis, the demonstration on MiniMax M2.7 reaches decode speeds up to 850 tokens per second (t/s) on short-context workloads and over 450 t/s on long-context workloads. For inference providers, that matters because even existing H200 infrastructure can be used in the stack for compute-heavy prefill while SN50 adds purpose-built decode capacity for a premium inference experience.
A Preview of SN50 Scale-Up
Today, we are showing what a single SambaRack SN50 with 16 RDU chips can do in a disaggregated setup with one NVIDIA H200 rack using four GPUs for prefill. But the real power of SambaRack SN50 comes from its ability to scale-up up to 256 chips. Over the coming months, we will show how SambaRack SN50 can scale from 16 RDU chips to 128 RDU chips, giving providers a path to balance low latency, high throughput, and cost-to-serve across frontier models and agent workloads.
