AIToday
Large Language ModelsRoboticsRobohubPublished: Sep 2, 2026, 19:01 JST2 min read

ICRA panel warns of paper flood

ICRA panel warns of paper flood

Key takeaway

  • An ICRA panel examined the growing flood of robotics papers.

  • They discussed the potential and risks of LLMs for literature review.

  • Panelists debated if peer review can scale to this new volume.

3 Key Points

  1. What happened

    At a recent ICRA panel, robotics researchers discussed how to handle the overwhelming number of publications. An estimate for 2025 suggests around 70,000 papers will contain the word "robotics," with growth beginning to rise exponentially around 2017.

  2. Why it matters

    The researchers identified core risks, such as "salami slicing" and the danger that LLMs could create "fake understanding" even when citations are real. Panelists also debated radical changes to peer review, including completely abandoning the traditional gatekeeper model.

  3. What to watch

    A case study of 2024 papers on learning from demonstration found that only 69 of 347 relevant papers were judged to have made notable contributions. One proposed remedy is to publish fewer, more integrated papers, though panelists acknowledged this is difficult.

Ask the AI about this article →

Context & Analysis

The panel's discussion highlights a field struggling with its own success. The roughly exponential growth in publications since 2017 has made it difficult for researchers to keep up, which threatens robotics' core strength as an integrative field. Kunpeng Yao's case study demonstrates this challenge, showing that a manual, year-long effort to read one subfield found only about 20 percent of papers made notable contributions.

The conversation also introduced new dimensions to the LLM debate. While tools could lower the barrier to entry for literature review, Nadia Figueroa's distinction of 'fake understanding'—where an LLM can generate structured and fluent but misleading overviews—points to a risk that goes beyond mere citation errors. This could lead to a field that produces more text but develops less understanding.

While no clean fix emerged, the panel discussions imply a shared sense that the current incentive structures may be unsustainable. Greg Dudek's vivid metaphor of building sandcastle walls as a 'tsunami' approaches acknowledges that incremental reform may be insufficient. The various proposals, from changing what is rewarded to creating new tracks for different contribution types or even reimagining peer review, all share a core goal: preserving the field's ability to connect ideas across domains before the deluge makes it impossible.

FAQ

What are the three orders of hallucination in LLMs described by Nadia Figueroa?
First-order hallucination involves fake or incorrect references. Second-order hallucination is when the reference is real but the model misstates what the paper did, and third-order is when the LLM invents plausible but false commonalities across papers.
What did the case study find about papers on learning from demonstration?
After manually screening 2024 papers from IEEE Xplore, the team identified 347 relevant papers. Of those, only 69 (about 20 percent) were judged to have made notable contributions.
What was Shigeki Sugano's radical proposal?
He proposed abandoning peer review altogether. Manuscripts would be uploaded to an open archive, and community evaluation under verified identities would happen in public, with journals certifying high-value work instead of being the only gate to visibility.

Get the latest Large Language Models news every morning

For example, today's edition would include:

  • Nvidia invests $3.5B in MediaTek to profit from custom AI chipsYahoo Finance AI · 1h ago
  • Paid actors, AI scripts: Viral anti-Democrat YouTube network exposedSemafor Tech · 1h ago
  • Claude Fable 5.1 Launch, Cache Costs Cut 75%Latent Space · 1h ago

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleClaude Fable 5.1 Launch, Cache Costs Cut 75%