Uday Ruddarraju, CTO for Compute, OpenAI
OpenAI has promoted Hyderabad-born engineer Uday Ruddarraju as its Chief Technology Officer for Compute, entrusting him with one of the company’s most critical responsibilities: ensuring that the computing infrastructure powering ChatGPT and future generations of AI models can keep pace with OpenAI’s soaring ambitions.The title may not command the same public attention as that of OpenAI CEO Sam Altman or its research leaders. Still, it is among the most strategically important roles in the company. As AI models become larger and more capable, the battle is increasingly shifting from algorithms to infrastructure. The winners will be determined not merely by who builds the smartest models, but by who can train and deploy them at the greatest scale and the lowest cost.That is precisely the challenge Ruddarraju has spent his career solving.Two-decade ExperienceAn engineering graduate from Chaitanya Bharati Institute of Technology in Hyderabad, Ruddarraju has built a reputation over nearly two decades as one of Silicon Valley’s highly regarded infrastructure engineers.Before joining OpenAI in 2025 as the Head of Compute and Infrastructure, he served as Head of Infrastructure Engineering at xAI and X, helping build the computing backbone for one of OpenAI’s fastest-growing rivals. Earlier, he held senior engineering roles at Meta, Robinhood, and eBay, where he worked on cloud infrastructure and more—technologies that underpin today’s digital economy.His move to OpenAI came at a time when the company was embarking on an unprecedented expansion of its computing capacity. Building frontier AI models now requires hundreds of thousands of graphics processors working in tandem, linked by ultra-fast networks, sophisticated software and enormous data centres. Procuring the chips is only the beginning. Designing systems that can keep them operating efficiently, reliably and economically is a far more complex engineering challenge.Training AI ModelsAs CTO for Compute, Ruddarraju now oversees that mission. His mandate extends well beyond hardware. It encompasses the software platforms, networking architecture, storage systems and operational frameworks that enable OpenAI to train increasingly powerful models while serving hundreds of millions of users around the world.The appointment also reflects a broader shift in the AI industry. For years, AI leadership was defined largely by advances in algorithms. Today, compute has emerged as the industry’s most valuable strategic resource. Companies are investing tens of billions of dollars in data centres, specialised chips and energy infrastructure because computing capacity has become one of the principal constraints.For India, Ruddarraju’s rise is another reminder of the country’s growing influence in global technology. Indian-origin executives have long led some of the world’s biggest technology companies. A newer generation of engineers is now helping shape the very foundations of the AI era, building the infrastructure on which future breakthroughs will depend.Ruddarraju may not yet be a familiar name outside engineering circles. But as OpenAI races to build ever more capable AI systems, the executive overseeing OpenAI’s compute infrastructure could become one of the most influential technologists working behind the scenes.Published on July 21, 2026
