Digital Event Horizon
NVIDIA Advances AI Inference with New LPX and CPX Platforms for Faster Performance and Lower Token Costs. With the launch of NVIDIA Groq 3 LPX, the company is extending Vera Rubin NVL72, enabling ultrafast responsiveness even across massive context windows while maximizing throughput and infrastructure utilization.
NVIDIA's Vera Rubin platform is being upgraded with NVIDIA Groq 3 LPX to accelerate AI inference, enabling ultrafast responsiveness and throughput. The new platform is designed to handle agentic AI systems that generate more tokens and process larger context windows. The Groq 3 LPX platform accelerates latency-sensitive decode workloads, while Rubin GPUs handle large-scale context processing. The platform has delivered 4x faster output tokens per second compared to the nearest alternative platform in an Artificial Analysis benchmark. Industry partners worldwide are adopting Vera Rubin platform solutions, including SpaceXAI and CoreWeave. NVIDIA's extreme codesign approach is reshaping the AI factory from end to end, optimizing every stage of the AI pipeline. The company's Spectrum-X Ethernet and NVLink Fusion innovations enable massive AI factory scale and customization. The Vera Rubin platform is being extended to support long-context inference and multi-agent systems, delivering performance, throughput, intelligence integrity, and economic efficiency simultaneously.
The AI landscape has undergone significant transformations in recent years, and the latest advancements in NVIDIA's Vera Rubin platform are poised to revolutionize the way we approach AI inference. With the launch of NVIDIA Groq 3 LPX, the company is extending Vera Rubin NVL72, which enables ultrafast responsiveness even across massive context windows while maximizing throughput and infrastructure utilization.
As AI shifts from training to reasoning and agentic, inference has become the new frontier. Agentic AI systems are generating more tokens, processing dramatically larger context windows, and increasingly collaborating with other AI systems to solve complex problems. These workloads demand a new class of infrastructure optimized not just for performance but for throughput, responsiveness, and economics at unprecedented scale.
NVIDIA's Vera Rubin platform is engineered to accelerate inference as agents reason over increasingly long sequences. The platform's architecture is designed to maximize responsiveness, throughput, and efficiency, helping to build infrastructure purpose-built for the emerging demands of long-context inference and multi-agent systems.
The new NVIDIA Groq 3 LPX platform brings a new low-latency inference architecture designed to work alongside Vera Rubin NVL72. LPX accelerates latency-sensitive decode workloads, while Rubin GPUs handle large-scale context processing. The result is faster, more predictable token generation that helps AI factories deliver responsive reasoning, smoother agent interactions, and greater infrastructure efficiency.
In an Artificial Analysis benchmark running Gemma 4 31B, an open-source agentic model, the NVIDIA Groq 3 LPX delivered 3,400 output tokens per second for 100,000-token long-context use cases critical to agentic systems, 4x faster than the nearest alternative platform.
Industry partners worldwide are adopting Vera Rubin platform solutions. SpaceXAI announced that NVIDIA Vera CPUs will power its next generation of agentic AI. CoreWeave has deployed into production Spectrum-X Multiplane, which connects NVIDIA Vera Rubin racks using multiple parallel switches to provide high-bandwidth, flat, and lossless AI networks. Nebius is the first AI cloud to adopt NVIDIA Groq 3 LPX.
NVIDIA's extreme codesign approach is reshaping the AI factory from end to end. By architecting compute, networking, and inference acceleration as a unified system, NVIDIA is helping customers build infrastructure purpose-built for the emerging demands of long-context inference and multi-agent systems.
The company's Spectrum-X Ethernet moves massive data flows efficiently across AI factories, and NVIDIA Groq 3 LPX is built to generate tokens at ultrafast speeds. Together, they show how NVIDIA is optimizing every stage of the AI pipeline, from context and communication to generation, as part of a single, integrated AI factory architecture.
The latest in NVIDIA's hardware-accelerated Spectrum-X Ethernet architecture, Spectrum-X Multiplane, enables massive AI factory scale on a flat, more resilient network. By splitting each server's network connection into several independent paths, or "planes," each running its own lightweight two-tier network, the platform delivers 1.6x better AI networking performance compared with off-the-shelf Ethernet.
NVIDIA Scale-In, the fifth pillar of NVIDIA AI networking, extends purpose-built acceleration to the infrastructure services that secure, manage, and operate the AI factory. Powered by the NVIDIA BlueField-4 processor and NVIDIA DOCA software platform, connected over NVIDIA Spectrum-X Ethernet, Scale-In transforms the traditional north-south access network into a unified, accelerated infrastructure domain.
NVLink Fusion, the latest innovation from NVIDIA, brings custom silicon into the company's world-leading AI infrastructure platform, enabling hyperscalers and AI-native companies to build semi-custom AI factories with greater performance, flexibility, and speed. By standardizing GPU- and XPU-based systems on a unified architecture, NVLink Fusion helps decouple data center buildout from silicon readiness.
With NVIDIA Groq 3 LPX in full production, the company is extending Vera Rubin inference for agents, delivering performance, throughput, intelligence integrity, and economic efficiency simultaneously. As the industry shifts from model training to serving intelligence at scale, infrastructure must evolve into what NVIDIA describes as a "token factory" capable of delivering performance, throughput, intelligence integrity, and economic efficiency simultaneously.
The emergence of agentic AI systems is creating a new performance challenge: decode latency. As AI agents reason, use tools, and interact with other systems, they generate responses one token at a time, causing even tiny delays to multiply across complex chains of work. To keep agents operating at the pace users expect, NVIDIA Groq 3 LPX extends the Vera Rubin NVL72 platform with specialized acceleration for token generation.
In conclusion, NVIDIA's latest advancements in Vera Rubin and Groq 3 LPX platforms are poised to revolutionize the way we approach AI inference. By optimizing every stage of the AI pipeline and delivering performance, throughput, intelligence integrity, and economic efficiency simultaneously, the company is helping customers build infrastructure purpose-built for the emerging demands of long-context inference and multi-agent systems.
Related Information:
https://www.digitaleventhorizon.com/articles/NVIDIA-Advances-AI-Inference-with-New-LPX-and-CPX-Platforms-for-Faster-Performance-and-Lower-Token-Costs-deh.shtml
https://blogs.nvidia.com/blog/vera-rubin-lpx-spectrum-x-nvlink-fusion/
Published: Mon Aug 24 15:11:34 2026 by llama3.2 3B Q4_K_M
