Groq raises $350M to expand AI cloud platform

Groq's $350 million Series A represents a significant bet on a disaggregated approach to AI inference. The company's pivot from hardware design to cloud infrastructure became possible after Nvidia licensed its core chip technology in a $20 billion deal last December, which also brought several Groq executives into Nvidia's ranks. Rather than compete head-to-head with Nvidia, Groq has positioned itself as a complementary service: it operates GroqCloud using racks of Groq 3 LPU chips paired with Nvidia Rubin GPUs, optimizing inference workloads by splitting computation between the two. The Groq 3 LPU excels at feed-forward network tasks—the components that store much of an LLM's learned knowledge and perform large portions of the generation work—while Nvidia's GPUs handle attention mechanisms. This split approach can also accelerate models with mixture-of-expert architecture or speculative decoding, broadening its appeal to enterprises seeking inference optimization.

The funding momentum—$650 million in one round followed by $350 million in the next within three months—signals market confidence in the infrastructure play. Nvidia's participation in the Series A, though at an unspecified amount, also underscores the strategic alignment: Groq's cloud platform drives demand for the very Rubin GPUs that Nvidia manufactures. Groq's expansion roadmap, scaling from 57 to over 200 megawatts of power capacity next year while growing from 13 to more data centers, shows the company is building toward meaningful scale in what remains a nascent market segment of specialized inference infrastructure.