In a bid to lower its GPU costs amid an unprecedented component shortage, Meta is on track to start making the latest versions of its AI-specific chip in September, Reuters reported, citing an internal memo.
At least one chip sailed through its testing phase in about six weeks, the memo said. Meta is working with Broadcom on the chip design, however it will use Taiwan’s TSMC to manufacture them. It is also buying RAM from Samsung, storage from Sandisk, and fiber optic equipment from Sumitomo Electric, according to the report.
Meta detailed the four new chips, developed under its Meta Training and Inference Accelerator (MTIA) program, in March, some of which are currently in deployment or will be this year or next. The company is taking a modular approach to designing these chips, anticipating that their needs will change as AI evolves rapidly by the time the chips are in production.
“Each MTIA generation builds on the last, using modular chiplets, incorporating the latest AI workload insights and hardware technologies, and deploying on a shorter cadence,” the company wrote at the time.
The chips are expected to help the company save on buying GPUs from chipmakers like Nvidia and AMD, although it still expects to spend plenty with those providers as well, Reuters reports. Meta intends to use the MTIA chips for training models for its ranking and recommendation algorithms, broader AI workloads, and inference aimed at its applications. The social media company has been producing its own AI chips since 2023.
