AIToday
AI Safety & AlignmentOpen-Source AITechCrunch AIPublished: Sep 18, 2026, 04:00 JST

Baseten's Base Labs, Hugging Face, Goodfire to build open-weight safety standard

Baseten's Base Labs, Hugging Face, Goodfire to build open-weight safety standard

3 Key Points

  1. What happened

    Baseten launched a safety infrastructure standard with its Base Labs research arm, partnering with Hugging Face and Goodfire AI to build evaluation and monitoring for open-weight models, which can be made dangerous by removing safeguards via abliteration.

  2. Why it matters

    The companies' goal is to make safety methods transparent and built into how models are trained and deployed, rather than bolted on afterward, according to Baseten's framing.

  3. What to watch

    The technical details of the partnership remain undisclosed, so the standard hinges on whether the partners can agree on how safety is built into open models. Watch for the open call to the broader developer ecosystem to contribute to the framework.

WHO IT HITSThis affects developers and researchers who train or deploy open-weight models, since Baseten and its partners are publishing safety methods and inviting the developer ecosystem to contribute to the framework.

Not sure about something? Ask the AI

Summaries like this, in your inbox every morning.

Context & Analysis

Baseten is not an unknown player in the AI infrastructure space. The company, an inference provider, raised a $1.5 billion Series F in June, vaulting its valuation to $13 billion, and spun up the Base Labs research group earlier this year. Its partner Goodfire AI is similarly well-capitalized, having raised a $150 million Series B led by B Capital earlier this year to advance its model interpretability platform. That financial backing suggests these are not fledgling experiments but well-funded efforts to shape how open models are trained and deployed.

The safety question around open-weight models has become more urgent as abliteration spreads. Hugging Face, which hosts open source AI models, currently lists over 6,000 abliterated models, a concrete measure of how readily safeguards can be stripped away. Baseten is framing its work as a \"standard\" for open models that is transparent and built into training and deployment, rather than bolted on afterward. In a post on X, the company said it believes openness is an advantage for AI safety, providing more visibility into model behavior and greater means of turning safety research into actionable controls than closed-source approaches.

Goodfire, which specializes in opening AI's \"black box\" to explain how models make decisions, is the likeliest candidate for the \"built into\" part of that equation, given its interpretability focus. Baseten is also putting out an open call to the broader developer ecosystem to contribute to the framework, saying it is building an ecosystem of open models that are safe and accessible to all. Whether this becomes a widely adopted standard or remains a well-funded but niche effort will likely depend on how many developers answer that call.

FAQ
What is abliteration?
A rising technique that removes safeguards from open-weight models, which can make them dangerous. Hugging Face currently lists over 6,000 abliterated models.
How will the partnership work technically?
The companies haven't disclosed how the partnership will work technically. Goodfire framed the goal as safety that must be built into open models and provided by those who serve them.

Get the latest AI Safety & Alignment news every morning

For example, today's edition would include:

  • Benioff to AI industry: self-regulate or get suedTop Companies AI · 16m ago
  • Progressive writer: don't reject AI just for communityTop Companies AI · 16m ago
  • AI agents erase audit trail, Vast Space audit chief warnsSiliconANGLE AI · 46m ago

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleAmazon launches Amazon Connect Talent for AI-led hiring