Robotics and edge AI put new pressure on computing infrastructure
Physical AI is forcing the technology industry to rethink the entire computing stack.
Robots, autonomous systems and intelligent devices need economical inference, secure data access and infrastructure that works beyond conventional clouds. Rafay Systems is addressing those demands through orchestration that lets providers offer open models without dedicating entire GPU systems to individual customers, potentially lowering enterprise AI costs while protecting sensitive information, according to Haseeb Budhani (pictured, right), co-founder and chief executive officer of Rafay Systems Inc.
“The serverless part at the infrastructure level, we’ve solved that … we’ve done for a while,” Budhani said. “Now we have a slice of essentially a confidential GPU. I can now have better security on top of the GPUs that I already have, which means as a provider, I get to monetize every second of my infrastructure. But, for the enterprise, it’s actually a better deal. They like that because they look at the total cost of ownership, they look at the capex and they don’t have the big money. It’s too expensive, otherwise. This allows them to have a secure solution, which actually delivers a better price point. That’s what everybody wants.”
