AMD, Supermicro and MinIO target the enterprise data pipeline bottleneck

Despite rapid advances in artificial intelligence, the enterprise world is still dealing with a data pipeline problem.

More than 80% of enterprise data is unstructured, and 99% of this data is dark to AI because there is no easy solution to query it, according to industry experts. Yet organizations are still trying to build AI systems that require consistent, governed access to this information, while dealing with the challenges of data fragmentation and interoperability.

As a result, data lakes and lakehouse architectures are emerging as critical components of the modern AI stack, and key industry players, including Advanced Micro Devices Inc., Super Micro Computer Inc. and MinIO Inc., are working on solutions to address issues in the data pipeline.

“From what we are seeing, enterprise customers today don’t have a big compute problem, but they actually have a data pipeline problem,” said Varun Selvaraj (pictured, center), business development manager of enterprise AI at AMD. “What’s happening is these customers are now sitting with massive amounts of unstructured data where their infrastructure is really not AI scale. Slowly, the shift is kind of changing towards not compute, but more towards data, moving the data across the system. How effectively can you move this data between systems?”