AIToday
AI Business & IndustryAI Stocks & MarketsTechCrunch AIPublished: Jul 17, 2026, 22:00 JST2 min read

GPU lender pivots to inference chips in $400M deal

GPU lender pivots to inference chips in $400M deal

Key takeaway

  • General Compute, an AI inference startup, has secured a $400 million(約640億円) loan from Upper90 collateralized by SambaNova inference chips—chips designed to run already-trained AI models cheaply and efficiently.

  • The deal marks a potential first in using inference-specific hardware as loan collateral and signals a broader market shift toward cheaper AI infrastructure running open-source models, as businesses seek alternatives to expensive tools from frontier AI labs.

3 Key Points

  1. What happened

    General Compute, an AI inference startup, secured a $400 million(約640億円) loan from Upper90 backed by SambaNova inference chips—marking what may be the first major financing deal to use inference-specific hardware as collateral rather than GPUs.

  2. Why it matters

    Inference chips are cheaper and more power-efficient than GPUs used for AI model training, enabling faster deployment across more data centers without water-cooling. As concerns grow over AI tool costs, this signals capital flowing toward infrastructure that runs open-source models more affordably than frontier lab LLMs.

  3. What to watch

    Upper90 previously financed GPU purchases for Crusoe Energy in 2021—at the time an unusual bet that later became standard practice after CoreWeave's chip-backed lending model led to a blockbuster IPO. General Compute's CEO Finn Puklowski frames the deal as the first sign of "capital organizing itself and the fragmenting of Nvidia's monopolistic dominance."

Ask the AI about this article →

Context & Analysis

The $400 million(約640億円) loan to General Compute represents a deliberate pivot by Upper90 away from GPU financing toward inference-specific hardware. Upper90's CEO Billy Libby, a former Goldman Sachs quantitative trader, previously pioneered chip-backed lending in 2021 when he financed GPU purchases for Crusoe Energy—a deal that faced skepticism from traditional lenders worried about GPU depreciation and market uncertainty. That strategy proved prescient: CoreWeave later built a business model around chip-backed loans and achieved a blockbuster IPO, normalizing this form of financing across the industry.

Now that GPU markets are mature and potentially oversupplied, Upper90 is positioning itself ahead of the next wave by backing companies focused on inference at a time when the open-source AI model ecosystem is growing stronger. Companies like OpenRouter and Fireworks are raising at significant valuations, and new models like Kimi's K3 are demonstrating competitive performance against releases from Anthropic and OpenAI. General Compute's bet on SambaNova silicon—rather than Nvidia—matters because it sidesteps dependence on a single dominant supplier. Competitors like TensorWave are making similar moves with AMD partnerships, suggesting a broader fragmentation of Nvidia's market position as customers seek cost-efficient alternatives.

FAQ

What is the difference between inference chips and GPUs?
Inference chips are optimized to run already-trained AI models quickly and efficiently, while GPUs are the more expensive chips used to build the models in the first place. SambaNova's SN50 chips are power-efficient and don't require water-cooling, allowing faster deployment across more data centers than GPU-based clouds.
When did General Compute raise its first funding?
General Compute raised a $15 million(約24億円) seed round in May to build an inference neocloud around SambaNova silicon.
How much faster is inference on the new chips compared to GPUs?
General Compute says the SN50 chips will provide 16 times faster inference than GPU-based clouds.

Get the latest AI Business & Industry news every morning

For example, today's edition would include:

  • Visko raises $10M, launches live AI video model OrbisSiliconANGLE AI · 2h ago
  • NVIDIA Leads 5 AI Stocks to Watch in SeptemberYahoo Finance AI · 2h ago
  • UAE AI firm pitches 95% video compression for Saudi securitySemafor Tech · 2h ago

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleGoogle's Gemini 3.5 Pro delay signals weakness in AI coding race