How many numbers does GPT-3 actually contain?

GPT-3 holds 175 billion numbers total, distributed across 577 spreadsheets (tensors). The first spreadsheet alone contains 617,558,016 numbers—a grid that is 50,257 rows tall and 12,288 columns wide.

What does the first spreadsheet in GPT-3 do?

The first spreadsheet is a dictionary. When you enter a word like "dog," it retrieves a row of 12,288 numbers assigned to that word. In GPT-2 (which the writer uses as an example), "dog" begins with the numbers 0.06, 0.07, 0.10, 0.12, -0.04, followed by 1,595 more numbers in the -1.0 to +1.0 range.

How large is GPT-3 as a file?

GPT-3 is approximately 350 GB, small enough to fit on the hard drive of a high-end laptop. However, most laptops lack sufficient RAM to effectively run it, which is why AI models typically run in data centers.

Large Language ModelsHacker NewsJul 15, 2026Jul 16, 2026, 01:00 JST

AI is just spreadsheets full of numbers, a tech writer discovers

Send on LINE

3 Key Points

What happened
A writer with no coding background set out to understand how large language models (LLMs) like ChatGPT actually work under the hood. After weeks of research, he concluded that AI systems are fundamentally built from massive grids of numbers arranged like spreadsheets—GPT-3, for example, contains 577 such "spreadsheets" (called "tensors" in technical terms) holding 175 billion numbers total.
Why it matters
The writer challenges the common assumption that AI is an impenetrable "black box." He argues that despite their complexity, we can actually see inside LLMs and understand how they function. This understanding matters because he believes the effort to demystify AI—by both experts and laypeople—is essential to keeping it safe. The realization that AI "looks like spreadsheets" makes a previously abstract technology concrete and potentially graspable for non-technical audiences.
What to watch
The writer's analogy breaks down quickly: while GPT-3's first spreadsheet is essentially a dictionary mapping words to vectors of numbers (50,257 words, each assigned 12,288 numbers), the remaining 576 spreadsheets perform more complex mathematical operations whose purpose requires deeper explanation. The author frames this as the beginning of a journey to explain how those numbers actually produce intelligent output.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Get news like this every morning, free

Context & Analysis

The writer's journey reflects a broader gap between how AI systems are publicly described and how they actually function. The phrase "black box" has become a convenient shorthand suggesting that AI's inner workings are unknowable, but the writer demonstrates this is partly a myth—or at least an oversimplification. GPT-3's architecture is well-documented: it is fundamentally a mathematical structure, not magic. The 577 spreadsheets, or tensors, are not randomly assembled; they are the product of a process called "training," after which the numbers are locked in place until the next model is released and trained anew. What makes this explanation valuable is that it shifts the conversation away from jargon ("self-attention," "neural networks") toward a more intuitive framing: numbers in grids. The writer notes that larger models like GPT-4 (rumored to contain two trillion numbers) and GPT-5 are built on the same basic architecture, just vastly scaled up. This insight suggests that understanding AI does not require a PhD—it requires patience, curiosity, and a willingness to ask simple questions that technical professionals might dismiss. The author's observation that we "must" understand AI in order to keep it safe points to a broader argument: demystification is itself a form of accountability.

FAQ

How many numbers does GPT-3 actually contain?: GPT-3 holds 175 billion numbers total, distributed across 577 spreadsheets (tensors). The first spreadsheet alone contains 617,558,016 numbers—a grid that is 50,257 rows tall and 12,288 columns wide.
What does the first spreadsheet in GPT-3 do?: The first spreadsheet is a dictionary. When you enter a word like "dog," it retrieves a row of 12,288 numbers assigned to that word. In GPT-2 (which the writer uses as an example), "dog" begins with the numbers 0.06, 0.07, 0.10, 0.12, -0.04, followed by 1,595 more numbers in the -1.0 to +1.0 range.
How large is GPT-3 as a file?: GPT-3 is approximately 350 GB, small enough to fit on the hard drive of a high-end laptop. However, most laptops lack sufficient RAM to effectively run it, which is why AI models typically run in data centers.

Hacker NewsRead Original Article

Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Get it free

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.