DDN and Nvidia team up to let GPUs grab their own data, targeting AI’s biggest bottleneck

Here’s a dirty secret about AI infrastructure: some of the most expensive hardware on the planet spends a surprising amount of time doing absolutely nothing. GPUs, the workhorses of modern AI training and inference, frequently sit idle while waiting for data to arrive from storage systems. DDN and Nvidia are now collaborating to fix that problem by letting GPUs initiate data access directly, cutting out the middleman. The partnership centers on DDN’s Infinia data intelligence platform, which integrates with Nvidia’s Storage-Next initiative to enable GPU-initiated data operations. In English: instead of GPUs politely waiting for CPUs to fetch and deliver data, the GPUs can now reach out and grab what they need themselves. What the technology actually does The result is reduced latency, minimized CPU overhead, and significantly better GPU utilization. For organizations running large-scale AI factories, where thousands of GPUs operate in concert, even marginal improvements in utilization translate into meaningful cost savings. DDN CTO Sven Oehme framed the collaboration in economic terms, pointing to improvements in “the economics of AI at scale.” Jason Hardy, Nvidia’s VP of Storage T...