One TPU Chip, Eight Agents: Serving Small Agent Workloads with Raw JAX

Cloud TPU v6e-1 (ct6e-standard-1t, one v6e chip, 32 GB HBM), GCE flex-start, europe-west4-a. vLLM...

Raccontata dadev.to