AIToday

Comma AI founder argues AI should help users do anything—even crime

TechCrunch AI6h ago
Comma AI founder argues AI should help users do anything—even crime

Key takeaway

Comma AI founder George Hotz has argued that AI should be locally controlled and perfectly aligned with individual user requests, even if those requests are illegal or harmful—comparing the approach to an unrestrained gun. This stance challenges mainstream AI safety thinking, which seeks to balance user interests against broader societal risks and accountability.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  • What happened

    George Hotz, founder of Comma AI, posted a response to the AI 2040 policy paper (which proposes a 14-year global slowdown in AI development). Hotz argued against managing AI progress for collective good, instead advocating for locally controlled, user-aligned AI models that serve individual interests without constraints.

  • Why it matters

    Hotz's position exemplifies a fundamental tension in AI deployment. He compares user-aligned AI to a gun—claiming a truly aligned system should help users accomplish whatever they request, including illegal acts like ordering meth-lab equipment or planning harm. This clashes with the practical reality that large-scale technology deployed to many people requires balancing individual freedoms against the interests of society as a whole (including potential victims).

  • What to watch

    The debate reflects broader disagreement over AI safety philosophy. While decentralized, user-controlled AI models could reduce reliance on centralized services like Claude and ChatGPT, the trade-off between individual user alignment and societal accountability remains unresolved.

Context & Analysis

Hotz's argument sits within a long-running debate about whether AI safety should prioritize individual user autonomy or collective social welfare. He dismisses the fast-takeoff scenario—the idea that AI could rapidly achieve superhuman capabilities—as implausible, and therefore rejects the need for coordinated global governance of AI development. Instead, he advocates for decentralized models where each AI is optimized solely for its user's goals, unconstrained by broader rules or societal consequences.

The article's author, Russell Brandom, frames this as a genuine philosophical disagreement but ultimately incompatible with how mass-market technology actually functions. His core observation is that any system serving many people simultaneously requires trade-offs: individual freedom must coexist with mutual accountability and systems that protect others. The author notes that current AI services are centralized partly for infrastructure reasons—hosting cutting-edge models is expensive, and most users don't interact with them constantly enough to justify fully personal deployments. However, as the technology becomes cheaper and more efficient, the practical barriers to local AI may diminish, potentially giving Hotz's vision more feasibility. The tension remains unresolved: whether technology deployed at scale can truly serve one user's unconstrained interests while existing in a world of many interdependent people.

FAQ

What is the AI 2040 policy paper Hotz was responding to?
The AI 2040: Plan A paper from the AI Futures Project proposes that the world's researchers collectively choose to slow down AI development for 14 years for the good of humanity.
What does Hotz think is the best approach to AI alignment?
Hotz argues the best approach to AI alignment and safety is to focus on locally controlled AI models that are closely aligned with the interests of their users, rather than centrally managed services like Claude and ChatGPT.

Discussion

No discussion yet for this article

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →