Ep. 62: Is AI Going to Kill Us All? - Prompting Curiosity | Lyssna här

Is AI actually going to kill us all?There's been a ton of talk about this topic in the media lately, and so I'm dedicating an episode to sharing my thoughts. Spoiler alert, no, I don’t think that AI is going to kill us, but that doesn’t mean that this technology has no risk. I walk through the Jacob Coxon resignation thread and the fact that Anthropic's own alignment team admits there's genuine risk, then get into why the doom talk feels more irresponsible than credible. I don't think regulation is coming to save us anytime soon, but to me, the answer isn't fear, it’s curiosity.

Main Topics Covered

Directly answering the question: Will AI kill us all?
Jacob Coxon's resignation thread on X
Evan Hubinger's tweets on AI risk
Defining superintelligence and recursive self-improvement (RSI)
Moving the goalposts from AGI to superintelligence
AI's coding and hacking capabilities
Jake Handy's prediction about a coming AI crisis
Why the AI-doom talk feels irresponsible
Regulation and data centers as oil
Dario Amodei's blog post
Change doesn't happen in a vacuum
How I used AI this week: Replacing my Jeep’s thermostat housing

Links & Resources for This Episode

Chapters

(00:00:05) - Intro and today's topic: will AI kill us all?
(00:03:29) - Background: Jacob Cox's resignation and Anthropic's Evan Hubinger
(00:05:18) - Defining superintelligence and recursive self-improvement
(00:07:19) - Why the doom claims seem overblown right now
(00:10:39) - Hacking risks and predictions of a coming AI-caused crisis
(00:12:15) - Irresponsible messaging and the case for transparency
(00:13:24) - Government incentives, profit motives, and the China narrative
(00:17:24) - Dario Amodei's regulation plan and skepticism about government action
(00:19:10) - Staying a realist: humans, open source, and hope for the future
(00:21:11) - How I Use AI This Week: the rattling thermostat story
(00:23:17) - Closing thoughts and sign-off

Rss