Nvidia pushes back on The Information’s report about its Groq 3 LPU

Nvidia issued a public correction this week targeting a report by The Information that, according to Nvidia, contained inaccurate claims about the Groq 3 Language Processing Unit and the strategic direction surrounding it. The denial is notable for the context around it. Nvidia’s LPU business is built on a roughly $20 billion licensing agreement with chip startup Groq that was announced in late 2025. What the Groq 3 LPU actually is Nvidia’s GPUs excel at high-throughput training and batch inference, processing massive amounts of data simultaneously. The Groq 3 LPU targets something different: low-latency, high-concurrency inference workloads, the kind of tasks where a user is waiting in real time for an AI response. The Groq 3 LPU was introduced publicly at Nvidia’s GTC 2026 event on March 16, 2026, as part of the company’s Vera Rubin AI platform. Each chip carries 500 MB of on-chip SRAM and delivers 150 TB/s of bandwidth for inference tasks. In rack-scale deployments, the LPX system integrates 256 Groq 3 LPUs per rack, built specifically to handle ultra-low-latency requirements at scale. Nvidia has been explicit that the LPU is meant to work alongside its GPU lineup, not replace i...