AMD just acquired Taalas, a Toronto-based AI chip startup that does something radical: it etches model weights directly into silicon. No HBM, no memory bottleneck — the model IS the chip. Early benchmarks show a test chip serving Llama 3.1 8B at 16,960 tokens per second. That was 48x faster than Nvidia's GPUs when announced in February 2026.
What Taalas Does Differently
Conventional AI inference works like this: model weights are stored in high-bandwidth memory (HBM), and the GPU's compute cores read them for every token generated. The memory bandwidth — not the compute — is the bottleneck. That's why Nvidia charges a premium for HBM3e and why everyone's racing to stack more memory closer to the compute.
Taalas throws out that model entirely. Their chips are model-specific integrated circuits (MSICs) — the weights are physically etched into the silicon during manufacturing. The chip doesn't load a model; the chip IS the model. This eliminates the memory bottleneck completely.
Think of it like the difference between a general-purpose computer running a program from disk, and a dedicated appliance where the program is baked into the circuitry. The appliance can't run anything else, but what it does, it does at hardware speed.
