AIToday
Large Language ModelsOpen-Source AIThe Register (AI/ML)Published: Aug 13, 2026, 04:01 JST

OpenWALDO launches transparent AI training dataset with 167B tokens

OpenWALDO launches transparent AI training dataset with 167B tokens

3 Key Points

  1. What happened

    Gregory Kurtzer, founder of CentOS and Rocky Linux, has launched OpenWALDO (Open Weights, Artifacts, Licenses, Data, Origins), an open-source AI training dataset funded by his company CIQ. The project currently contains 167.3 billion reference tokens drawn from government records, academic papers, mailing lists, and public domain literature.

  2. Why it matters

    Most open-weight AI models use closed-source training data of unknown origin and licensing, creating risks for customers and wasting computing resources through duplicate industry efforts. OpenWALDO aims to make training data transparent and auditable, letting companies add their own proprietary data on top of a verified public baseline—a model Kurtzer argues mirrors how open-source software succeeded by being inspectable and community-validated rather than proprietary.

  3. What to watch

    The 167.3 billion tokens in OpenWALDO represent a small fraction compared to the tens of trillions used to train frontier models. Adoption by AI companies will determine whether the project becomes a shared industry foundation or remains a niche effort; CIQ did not confirm whether any model has yet been trained on the dataset.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

OpenWALDO addresses a growing tension in the AI industry: despite the rise of downloadable open-weight models, their training data remains opaque. Companies and labs typically draw from copyrighted material, distilled responses from other models, or user-generated content obtained without clear consent—sources that are neither disclosed nor auditable. This opacity creates two problems the project aims to solve. First, it poses practical risk: customers cannot know whether a model's foundation is tainted, putting their software stacks in jeopardy. Second, it wastes resources: without a shared baseline, every organization duplicates the effort of curating and validating training data.

Kurtzer's approach borrows from open-source software's playbook. Rather than keeping the dataset proprietary or claiming safety through obscurity, OpenWALDO makes sources traceable and forkable. Companies can then layer their own proprietary data on top of the public baseline, creating a clear audit trail from final model back to its foundations. This model has already resonated with businesses questioning why they pay for closed AI services they cannot control or inspect, especially as open-weight models from China begin matching the capabilities of proprietary alternatives like ChatGPT and Claude.

However, OpenWALDO faces a steep climb. The 167.3 billion tokens currently available are a drop next to the tens of trillions used by frontier labs, and it remains unclear whether any model has been trained on the dataset yet. Adoption requires the AI industry to abandon its closed-data practices—a shift that took decades for open-source software and may prove harder in an AI landscape where companies view proprietary training data as a core competitive advantage.

FAQ
What sources make up the 167.3 billion tokens in OpenWALDO?
The dataset is pulled from government records, open-source academic papers, mailing lists, and public domain literature.
Who is behind OpenWALDO and why did they start it?
Gregory Kurtzer, founder of CentOS and Rocky Linux, leads the project and funded it through CIQ, his AI infrastructure company. Kurtzer argues that open-weight models lack true transparency because their training data sources and licenses are hidden, and that a shared public dataset would reduce duplicate industry work and make data sources auditable.
How does OpenWALDO compare in size to other training datasets?
The 167.3 billion tokens in OpenWALDO are a small fraction compared to the tens of trillions of tokens used to train frontier AI models and their open-weight counterparts.
The Register (AI/ML)Read Original Article

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleBurry doubles down on Nvidia, Palantir shorts; bets big on Molina Healthcare