OpenAI security chief Jan Leike joins Amazon-backed Anthropic
Anadolu | Anadolu | Getty Photographs
Jan Leike, one of many lead security researchers at OpenAI who resigned from the factitious intelligence firm earlier this month, mentioned on Tuesday that he has joined rival AI startup Anthropic.
Leike introduced his resignation from OpenAI early on Might 15, days earlier than the corporate dissolved the superalignment group that he co-led. That group, fashioned in 2023, targeted on long-term AI dangers. OpenAI co-founder Ilya Sutskever introduced his departure in a put up on X on Might 14.
“I am excited to affix @AnthropicAI to proceed the superalignment mission,” Leike wrote on X on Tuesday. “My new group will work on scalable oversight, weak-to-strong generalization, and automatic alignment analysis.”
Anthropic is backed by Amazon, which has committed up to $4 billion in funding for a minority stake within the firm.
In a put up following his departure from OpenAI, Leike wrote, “Stepping away from this job has been one of many hardest issues I’ve ever accomplished, as a result of we urgently want to determine learn how to steer and management AI techniques a lot smarter than us.”
AI security has gained fast significance throughout the tech sector since OpenAI launched ChatGPT in late 2022, ushering in a increase in generative AI merchandise and investments. Some within the business have expressed concern that firms are transferring too rapidly in releasing highly effective AI merchandise to the general public with out adequately contemplating potential societal hurt.
Microsoft-backed Open AI said Tuesday that it created a brand new security and safety committee led by senior executives, together with CEO Sam Altman. The committee will suggest “security and safety selections for OpenAI initiatives and operations” to the corporate’s board.
Anthropic, based in 2021 by siblings Dario Amodei and Daniela Amodei and different ex-OpenAI executives, launched its ChatGPT rival Claude 3 in March. The corporate has acquired funding from Google, Salesforce and Zoom, along with funding from Amazon.
