We're excited to announce prompt caching is now live on SambaCloud, starting with support for MiniMax M2.7. If your application sends repeated requests that share a long, stable prefix, such as a system prompt, a reference document, or a set of few-shot examples, prompt caching can meaningfully cut both your latency and your bill, with zero changes required on your end.
TL;DR
Prompt caching is now live on SambaCloud, starting with MiniMax M2.7, so applications that resend a long, stable prefix (a system prompt, reference document, or set of few-shot examples) get faster, cheaper inference with zero code changes.
It runs on Automatic Prefix Caching (APC): when a new request shares a common prefix with one recently processed, those tokens are served from cache instead of recomputed, and it turns on automatically once the prefix clears a minimum length threshold of 4,096 tokens.
Cached tokens are billed 90% below standard input pricing, which for MiniMax M2.7 means $0.06 per million tokens instead of $0.60 on any part of the prompt that hits the cache.
