Christiano backs extinction warning, joins OpenAI safety team

The warning comes from inside the field, not from outside critics. Paul Christiano co-authored an influential 2016 AI safety paper with Dario Amodei, who later founded Anthropic. Christiano had long been known as a believer that AI would take off relatively gradually and be made safe — a position this shift reverses. His announcement that he is joining OpenAI's nonprofit safety team is the concrete step attached to that reversal.

His warning did not land alone. Geoffrey Hinton, one of the three so-called "Godfathers of AI," told the BBC that a 10% risk of human extinction "seems a not unreasonable estimate," a comment that echoed what one of Anthropic's top AI alignment scientists had said a day earlier. Read together, the two statements suggest the most dire framing is no longer confined to a fringe, but is being voiced by people with deep ties to the field's leading labs.

What happens next likely hinges on whether these warnings translate into changes in how safety work is prioritized inside those labs, with Christiano's move to OpenAI's nonprofit safety team as one early indicator. The 10% figure and the comments from Anthropic's alignment scientists may also shape how the wider public and policymakers weigh the risk.