OpenAI researcher who resigned over security concerns joins Anthropic

Jan Leike, a key researcher at OpenAI who resigned earlier this month citing “security concerns,” has joined competitor Anthropic to “work on scalable supervision, weak-to-strong generalization, and automated alignment research,” according to the publication. of Leike in X.

Anthropic has positioned itself as the antithesis of OpenAI: a public benefit corporation dedicated to cautious progress. It was founded by former OpenAI employees who left, according to the Financial times, because they believed OpenAI was straying from its mission of developing safer and more ethical AI and focusing too much on commercial interests after the billion-dollar deal with Microsoft. For those following the AI ​​drama, Leike joining Anthropic is no surprise.

“We are long overdue for taking the implications of AGI incredibly seriously. We must prioritize preparing for them as best we can,” Leike said in follow-up posts about his resignation a few weeks ago. “Only then can we ensure that AGI benefits all humanity.”

Leike previously worked on OpenAI’s “Superalignment” team, which appears to align with her role at Anthropic, ensuring intelligent systems are designed to act in accordance with human values. In his thread after announcing his resignation, Leike criticized OpenAI for not providing enough computing resources to ensure success.

For its part, Anthropic employs “constitutional AI,” which incorporates ethical principles into training an AI model by gathering feedback from the public and integrating concepts from sources such as the United Nations Universal Declaration of Human Rights, as I previously reported.

Another notable departure from OpenAI is its co-founder, Ilya Sutskever, who left earlier this month and had reportedly been absent from the office since leading a failed coup against CEO Sam Altman in November. Although Sutskever resigned and has yet to indicate his next move, his values ​​align with those of Anthropic, making it a plausible destination for him, along with Leike.