Organizations

Who is working on it

Frontier labs, safety researchers and government institutes.

AI safety and research company building frontier models (Claude) with a focus on alignment and interpretability.

Research and field-building to reduce societal-scale risks from AI.

Oxford University institute studying existential risks, including from superintelligence. Directed by Nick Bostrom.

Frontier AI lab with the stated mission of building AGI responsibly. DeepMind was founded in London and merged with Google Brain in 2023.

Mathematical and theoretical research on aligning smarter-than-human AI. Founded as the Singularity Institute for Artificial Intelligence.

Frontier AI lab whose stated mission is to ensure AGI benefits all of humanity.

Company co-founded by Ilya Sutskever with the single goal of building safe superintelligence.

UK government body evaluating the safety of advanced AI models. Launched as the AI Safety Institute and renamed in 2025.