NeurIPS uses hidden AI prompts to catch cheating reviewers

Key takeaway

• Academic conferences NeurIPS and ICML 2026 are inserting hidden instructions into peer-review papers to catch reviewers who use AI chatbots to write reviews, violating confidentiality and peer-review norms.

• One similar effort at ICML caught hundreds of offenders and earned broad researcher support, but critics warn the tactic presumes bad faith and may backfire by punishing honest reviewers who mistake organizer prompts for author misconduct.

3 Key Points

FAQ

What does the hidden prompt method actually do?

Conference organizers embed concealed instructions into papers sent to peer reviewers that tell large language models to use telltale phrases—such as "This work addresses the central challenge" and "The claims of the paper"—in their reports, making AI-generated reviews identifiable.

How effective has this approach been?

At ICML 2026, a similar hidden-prompt effort identified hundreds of reviewers misusing AI, leading to rejection of their reviews. The conference desk-rejected just under 500 papers over LLM review policy violations, about 2 percent of total submissions, and researchers expressed overwhelming support for the strategy.

What is the policy on AI use in peer review at these conferences?

NeurIPS bans peer reviewers from uploading papers they referee to AI chatbots because it breaches confidentiality, though reviewers are permitted to use AI chatbots for background research. Many other publishers similarly ban AI use in peer review.