Hundreds of prominent AI scientists and other notable figures signed a statement in 2023 saying that mitigating the risk of extinction from AI should be a global priority. At 80,000 Hours, we’ve considered risks from AI to be the world’s most pressing problem since 2016.

But what led us to this conclusion? Could AI really cause human extinction? We’re not certain, but we think the risk is worth taking very seriously.

In particular, as companies create increasingly powerful AI systems, there’s a concerning chance that:

• These AI systems may develop dangerous long-term goals we don’t want.
• To pursue these goals, they may seek power and undermine the safeguards meant to contain them.
• They may even aim to disempower humanity and potentially cause our extinction.

This article is written by Cody Fenwick and Zershaaneh Qureshi, and narrated by Zershaaneh Qureshi. It discusses why future AI systems could disempower humanity, what current AI research reveals about behaviours like power-seeking and deception, and how you can help mitigate the dangers.

You can see the original article — packed with graphs, images, footnotes, and further resources — on the 80,000 Hours website:

https://80000hours.org/problem-profiles/risks-from-power-seeking-ai/

Chapters:

• Risks from power-seeking AI systems (00:01:00)
• Introduction (00:01:17)
• Summary (00:03:09)
• Why are the risks from power-seeking AI a pressing world problem? (00:04:04)
• Section 1: Humans will likely build advanced AI systems with long-term goals (00:05:43)
• Section 2: AIs with long-term goals may be inclined to seek power (00:11:32)
• Section 3: These power-seeking AI systems could successfully disempower humanity (00:26:26)
• Section 4. People might create power-seeking AI systems without enough safeguards, despite the risks (00:38:34)
• Section 5: Work on this problem is neglected and tractable (00:47:37)
• Section 6: What are the arguments against working on this problem? (00:59:20)
• Section 7: How you can help (01:25:07)
• Thank you for listening (01:28:56)

Audio editing: Dominic Armstrong
Production: Zershaaneh Qureshi, Elizabeth Cox, and Katy Moore

With Claude Mythos we have an AI that knows when it's being tested, can obscure its reasoning when it wants, and is better at breaking into (and out of) computers than any human alive. Rob Wiblin works through its 244-page System Card and 59-page Alignment Risk Update to explain why:

• Mythos is a nightmare for computer security
• It has arrived far ahead of schedule
• It might be great news for alignment and safety
• But 3 key problems mean we can’t take its alignment results at face value
• Mythos isn’t building its replacement yet, probably
• Anthropic staff are, for the first time, kinda scared of Claude
• He's losing sleep

Learn more & full transcript: https://80k.info/mythos

This episode was recorded on April 9, 2026.

Chapters:

• Why people are panicking about computer security (01:05)
• Mythos could break out of containment (04:23)
• Anthropic is losing billions in revenue by not releasing Mythos (06:21)
• Mythos is actually the most aligned model to date, except… (07:48)
• Mythos knows when it’s being tested (09:52)
• Mythos can hide its thoughts (11:50)
• Mythos can’t be trusted about whether it’s untrustworthy (14:02)
• Does Mythos advance automated AI R&D? (17:03)
• Mythos scares Anthropic (19:15)

Video and audio editing: Dominic Armstrong, Milo McGuire, Luke Monsour, and Simon Monsour
Camera operator: Dominic Armstrong
Production: Elizabeth Cox, Nick Stockton, and Katy Moore