GPUs changed the equation of enterprise compute. AMD and Dell say agentic AI is flipping the math once again
As enterprises graduate from AI experimentation to production-scale agentic deployments, the infrastructure assumptions of the chatbot era are rapidly giving way to a more distributed and cost-conscious hybrid AI architecture.
The shift is playing out in real time, with the AI factory emerging as the central organizing principle for rearchitecting enterprise compute. Token economics, data gravity and constrained data center power density are forcing a hard look at which workloads belong on-premises, which belong at the edge and which warrant frontier-model API calls, according to Suresh Andani (pictured, left), corporate vice president for compute and enterprise AI at Advanced Micro Devices Inc. That’s where AMD’s MI350P — a GPU card designed to slot into existing servers — comes in.
“About 70% of enterprise data centers are 30-kilowatt rack power density or lower — and about 50% of them are lower than about 15 kilowatts,” Andani said. “If you are a traditional data center and you have ambitions to be an AI-sophisticated enterprise, what do you do? That’s where [the MI350P] comes in, where you can take your existing servers … and plug in these 350P cards and still get 150, 170 billion parameter inference models running very efficiently.”
