How I built a 6-node 12-GPU on-prem AI cluster running 1000+ agents

TL;DR — 6 machines, 12 GPUs, 1,000+ concurrent agents, P95 18 ms, voice <300 ms, 280,741 lines of...

Raccontata dadev.to