Back to articles

Researcher attempts to fine-tune a Chinese LLM to perfectly regenerate Borges' 'Pierre Menard' story token-by-token rather than merely imitate it.

LessWrong AI · April 20, 2026

Researcher attempts to fine-tune a Chinese LLM to perfectly regenerate Borges' 'Pierre Menard' story token-by-token rather than merely imitate it.

AI Summary

  • The goal is not to create a Borgesian-style story but to have the model generate the exact text of 'Pierre Menard, Author of the Quixote' through its weights
  • Initial approach involved using Kimi K2.5-Thinking with Borges' complete biography and literary influences in the system prompt, but the 256K-token context window proved insufficient by five orders of magnitude
  • The project treats this as a technical challenge distinct from simple memorization or machine transcription, requiring the model to generate text that perfectly coincides with the original work

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free