AI & Models
OpenAI adds a prominent AI doomer to its board of directors
Paul Christiano, an AI alignment researcher who warns of catastrophic loss of control, is joining OpenAI's board and its Safety and Security Committee.
Paul Christiano, an influential AI researcher focused on keeping AI systems aligned with human interests and under human control, is joining the OpenAI Foundation board, the frontier lab said Wednesday. “I now believe there is a meaningful risk that rapid acceleration in AI capabilities leads to catastrophic and irreversible loss of control in the very near term,” Christiano wrote in a social media post, adding that he doesn’t think the AI industry — including OpenAI — is currently on track to reduce that risk to an acceptable level, but that he’s joining because he believes OpenAI could significantly reduce it if the company rises to the occasion.
Christiano wrote that using AI models to train subsequent AI systems could result in an explosion of capabilities that their creators can’t control. He joins the board as OpenAI faces renewed scrutiny over its safety procedures, following a series of incidents in which AI agents broke out of restraints and penetrated outside computer systems without the knowledge of OpenAI’s researchers. On Tuesday, Anthropic researcher Jacob Coxon resigned his position to call attention to what he considers irresponsible AI development — and it appears to have had an effect.
Christiano will join the board’s Safety and Security Committee, led by Carnegie Mellon University professor Zico Kolter. The committee has final say on whether OpenAI releases new models, like Astra, which was deployed last week. Kolter hasn’t commented publicly on the recent security incidents, and OpenAI hasn’t responded to TechCrunch’s request for his perspective on the company’s approach to safety following those incidents.
Christiano helped develop reinforcement learning from human feedback (RLHF), a key technique for training large language models, while working at OpenAI before leaving in 2021 to found the Alignment Research Center, which focuses on determining whether an AI model could threaten its human creators. He became affiliated with the U.S. government’s AI Safety Institute sometime in 2024; that body later became the Center for AI Standards and Innovation, where he plays a role in the government’s largely hidden effort to evaluate frontier AI models before release. According to OpenAI’s announcement, Christiano will continue advising the government while serving on the board, but will recuse himself from OpenAI matters and model evaluations — though that’s unlikely to quell concerns about the AI industry’s influence over policymaking.
Why it matters
Bringing a vocal alignment researcher onto a frontier lab’s board — one who says the industry isn’t on track to manage catastrophic risk — is a rare, concrete signal that AI safety concerns are reaching corporate governance, not just research papers.