Nvidia CEO Jensen Huang.
Chung Sung-Jun/Getty Images
Rising memory prices are making AI infrastructure more expensive — and Nvidia's biggest customers could be in for serious sticker shock.Last month, Meta CEO Mark Zuckerberg and Microsoft CFO Amy Hood cited rising memory costs for chips and data centers as a key factor in their increased AI spending. The surge has helped fuel a boom in memory stocks.Research firm Bernstein said in a note to investors this week that the impact could become more pronounced with Nvidia's next-generation AI systems. For Nvidia, these rising costs could be a substantial growth driver.The firm estimates Nvidia's coming Vera Rubin NVL72 system — used to train and run advanced AI models — will cost about $9.1 million per rack.Memory makes up a big part of that pricetag. Bernstein says high-bandwidth memory prices will more than triple by the time Rubin ships at scale, pushing memory and storage costs to $3.2 million per rack — or more than a third of the total cost.That could mean Nvidia's biggest customers will rack up higher bills. Bernstein estimates a 1-gigawatt Vera Rubin data center would cost about $47 billion to build, compared to $40.5 billion for building data centers with Vera Rubin's predecessor chips.It's not just memory. Bernstein also flagged that networking, cooling, and power-delivery costs are rising and contributing to higher prices.
