HomeAI · summaries
Storia in 2 fonti
Smaller, faster, safer: running Kimi and GLM at scale
Serving frontier models like Kimi and GLM means fighting for GPU memory. Here's how we quantize KV caches, compress model weights, and add integrity checks to serve them faster, cheaper, and safely.
Confronto fonti
2 prospettive sulla stessa storiaTimeline cronologica
- ·
blog.cloudflare.com
Smaller, faster, safer: running Kimi and GLM at scale
Serving frontier models like Kimi and GLM means fighting for GPU memory. Here's how we quantize KV caches, compress model weights, and add integrity checks to serve them faster,…
- ·
dev.to
How a 176 KB C Binary Runs a 2.78-Trillion-Parameter Model on One CPU with 8 GB of RAM
A deep dive into kimi-k3-in-c — a pure C99 inference engine that runs Kimi K3 on a single CPU with zero GPUs. Four architectural reductions achieve a 676× memory compression while…