AIToday
AI Stocks & MarketsAI Business & IndustryTechCrunch AIPublished: Jul 17, 2026, 22:00 JST

GPU lender pivots to inference chips in $400M deal

GPU lender pivots to inference chips in $400M deal

3 Key Points

  1. What happened

    General Compute, an AI inference startup, secured a $400 million(約640億円) loan from Upper90 backed by SambaNova inference chips—marking what may be the first major financing deal to use inference-specific hardware as collateral rather than GPUs.

  2. Why it matters

    Inference chips are cheaper and more power-efficient than GPUs used for AI model training, enabling faster deployment across more data centers without water-cooling. As concerns grow over AI tool costs, this signals capital flowing toward infrastructure that runs open-source models more affordably than frontier lab LLMs.

  3. What to watch

    Upper90 previously financed GPU purchases for Crusoe Energy in 2021—at the time an unusual bet that later became standard practice after CoreWeave's chip-backed lending model led to a blockbuster IPO. General Compute's CEO Finn Puklowski frames the deal as the first sign of "capital organizing itself and the fragmenting of Nvidia's monopolistic dominance."

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The $400 million(約640億円) loan to General Compute represents a deliberate pivot by Upper90 away from GPU financing toward inference-specific hardware. Upper90's CEO Billy Libby, a former Goldman Sachs quantitative trader, previously pioneered chip-backed lending in 2021 when he financed GPU purchases for Crusoe Energy—a deal that faced skepticism from traditional lenders worried about GPU depreciation and market uncertainty. That strategy proved prescient: CoreWeave later built a business model around chip-backed loans and achieved a blockbuster IPO, normalizing this form of financing across the industry.

Now that GPU markets are mature and potentially oversupplied, Upper90 is positioning itself ahead of the next wave by backing companies focused on inference at a time when the open-source AI model ecosystem is growing stronger. Companies like OpenRouter and Fireworks are raising at significant valuations, and new models like Kimi's K3 are demonstrating competitive performance against releases from Anthropic and OpenAI. General Compute's bet on SambaNova silicon—rather than Nvidia—matters because it sidesteps dependence on a single dominant supplier. Competitors like TensorWave are making similar moves with AMD partnerships, suggesting a broader fragmentation of Nvidia's market position as customers seek cost-efficient alternatives.

FAQ
What is the difference between inference chips and GPUs?
Inference chips are optimized to run already-trained AI models quickly and efficiently, while GPUs are the more expensive chips used to build the models in the first place. SambaNova's SN50 chips are power-efficient and don't require water-cooling, allowing faster deployment across more data centers than GPU-based clouds.
When did General Compute raise its first funding?
General Compute raised a $15 million(約24億円) seed round in May to build an inference neocloud around SambaNova silicon.
How much faster is inference on the new chips compared to GPUs?
General Compute says the SN50 chips will provide 16 times faster inference than GPU-based clouds.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleTaiwan chip testing firms surge as AI server demand soars