“Anthropic Risk Report: August 2026” by Zvi

I am grateful that Anthropic is producing periodic Risk Reports.

At first I was skeptical. It turns out I was wrong. Anthropic is revealing a lot of new information, some of it rather alarming, that it did not have to disclose, and is providing detailed insight into how they think about things. This is very cool.

Thus I found this report to be a moderately positive update overall, if we presume they are not silently omitting the worst of it. There are a bunch of not great things we find out about, but I would have expected some set of mistakes at least as bad, and I wouldn’t have expected them to choose to tell us about all of it.

It does mean one more set of 186 page documents I have to read every so often, almost all of which is meaningfully new material this time around.

The other revelation is the existence of the world's likely best model, ‘Model 2.’

This was a rough one to fully get through, so apologies in advance for any errors of interpretation.

Table of Contents

1. Agent Model 1 and Agent Model 2.
2. [...]

---

Outline:

(01:11) Agent Model 1 and Agent Model 2

(02:49) Executive Summary (1)

(04:13) The Rules Are Serious But Not Literal

(06:24) Misalignment Is a State of Mind (2.5)

(11:40) Autonomy Threat Model 1: Misalignment in High-Stakes Settings (2)

(14:28) Some Strange Uses Of The Word Safe I Wasn't Previously Aware Of

(15:53) Now Versus Future (2.17)

(16:29) The Core Claims And Argument (2.6)

(26:44) The Rest of the Important Arguments In Section 2

(28:59) Risk Assessment (2.19)

(29:47) Pre-Internal-Deployment Review (2.18)

(30:49) A Guide To Internal Use Monitoring (2.23.1)

(37:11) Blocking Interventions (2.23.2)

(38:28) The Power Seeking Environment Evaluation (2.24)

(39:25) Opus 4.8-Reward-Hacker (2.25)

(41:31) Autonomy threat model 2: Risks from automated R&D (3)

(42:29) Yes That Does Seem Kind Of Risky

(44:53) Could We Replace Our Researchers?

(46:27) How Much Could We Be Accelerating Our AI Researchers?

(49:43) What Could Possibly Go Wrong If We Replaced Our Researchers?

(50:23) Risk Mitigations For AI R&D Automation

(53:42) Overall Risk From Automation of AI R&D

(53:56) Biological and Technically Also Chemical Weapons Production

(54:45) The Threat Models for Biological and Chemical Weapons

(59:52) Model Capabilities (4.4)

(01:01:13) Classifiers (4.5)

(01:03:04) Acceleration Dynamics (5.1)

(01:04:06) Distillation (5.1.1)

(01:05:17) Safety Process Failures (5.2)

(01:05:31) Refusing To Find Innovative Misalignment Techniques (5.2.2)

(01:06:47) Exposing the Chain of Thought Reasoning To Grading Pressure Quite a Lot (5.2.3)

(01:08:15) Directly Training On Misaligned Behavior During a Production Training Run (5.2.4)

(01:10:42) An instance of unmonitored unrestricted agents with access tosensitive resources (5.2.5)

(01:11:43) Repeated training on alignment-faking transcript datasets (5.2.6)

(01:14:17) Benefits From Anthropic's Operating as a Frontier AI company (5.3)

(01:16:20) Model Weight Security (6.4)

(01:16:42) Risk Has Been Reported

---

First published:
August 18th, 2026

Source:
https://www.lesswrong.com/posts/dA8gohzABk6vT7yzP/anthropic-risk-report-august-2026

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.