AIToday
Large Language ModelsAI Safety & AlignmentLessWrong AIPublished: Oct 2, 2026, 01:00 JST

GPT-2 vs preschooler: 27 terabytes of data is the gap

GPT-2 vs preschooler: 27 terabytes of data is the gap

A LessWrong essay argued that comparing GPT-2 with a preschooler is almost completely disjoint, noting they share only rudimentary language and the ability to miscount R's in "strawberry". The essay estimated a preschooler consumes at least 27 terabytes of video data by age 3, or about 3.6 petabytes uncompressed.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleDevOps engineer: Hermes Agent build cost him the thrill