
What happened
The 40th Annual Conference on Neural Information Processing Systems (NeurIPS), scheduled for Sydney in December 2026, has embedded concealed instructions for large language models in peer-review papers to detect reviewers uploading those papers to AI chatbots in violation of policy. The hidden prompts instruct LLMs to use specific phrases like "This work addresses the central challenge" in their reports, making AI-generated reviews identifiable.
Why it matters
Peer review depends on human judgment and confidentiality; uploading papers to AI chatbots breaches both. A similar effort at ICML 2026 in Seoul caught hundreds of reviewers misusing AI and led to rejection of reviews, suggesting the method can enforce standards that many publishers now require. However, some researchers argue the approach—treating reviewers as suspects rather than building trust—risks corroding the culture peer review needs.
What to watch
At ICML 2026, hidden prompts led to desk rejection of just under 500 papers over LLM review policy violations, representing about 2 percent of total submissions. Some reviewers have already flagged the NeurIPS prompts after spotting them when converting PDFs to Word, raising the possibility that papers may be incorrectly rejected if reviewers don't realize the prompts came from organizers, not authors.
Summaries like this, in your inbox every morning.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.