AIToday
Large Language ModelsVentureBeat AIPublished: Mar 28, 2026, 04:00 JST

IndexCache technique from Tsinghua University and Z.ai accelerates long-context LLM inference by up to 1.82x by eliminating redundant sparse attention computations.

IndexCache reduces redundant computation in sparse attention models by up to 75%, significantly speeding up processing of 200,000-token contexts

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

VentureBeat AIRead Original Article

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleTech companies face mounting pressure over data center energy demands as senators investigate power grid impacts and environmental concerns