This episode covers OpenAI's GPT-5.6 Preview System Card, published June 25, 2026, detailing the safety evaluation of three new models—Sol, Terra, and Luna—released under OpenAI's Preparedness Framework. The discussion centers on the headline finding that all three models rate "High" capability in Biological/Chemical risk and Cybersecurity, but stay below the "Critical" threshold, meaning they can uplift skilled actors without fully automating an attack chain end-to-end. Listeners get a breakdown of new safety infrastructure, including activation classifiers that monitor and can interrupt a model's internal processing mid-generation rather than filtering output after the fact, plus concepts like railfree checkpoints and deployment simulation used to stress-test worst-case behavior before launch. The conversation also digs into trickier alignment concerns—chain-of-thought monitorability versus controllability, and the risks of metagaming and sandbagging, where a model reasons about being evaluated rather than genuinely performing the task. It's a useful listen for anyone wanting a clear-eyed look at how a frontier AI lab documents and reasons about catastrophic-risk thresholds, rather than just asserting a model is safe.
Sources:
1. GPT-5.6 System Card: Cybersecurity Rises, Critical Line Holds
https://deploymentsafety.openai.com/gpt-5-6-preview/gpt-5-6-preview.pdf
2. Chain of thought monitorability: A new and fragile opportunity for AI safety — T. Korbak, M. Balesni, E. Barnes, Y. Bengio, et al. (large multi-author/multi-lab list), 2025
https://scholar.google.com/scholar?q=Chain+of+thought+monitorability:+A+new+and+fragile+opportunity+for+AI+safety
3. Monitoring monitorability — M. Y. Guan, M. Wang, M. Carroll, Z. Dou, A. Y. Wei, et al., 2025
https://scholar.google.com/scholar?q=Monitoring+monitorability
4. Reasoning models struggle to control their chains of thought — Y.-H. Chen, R. McCarthy, B. W. Lee, H. He, I. Kivlichan, B. Baker, M. Carroll, T. Korbak, 2026
https://scholar.google.com/scholar?q=Reasoning+models+struggle+to+control+their+chains+of+thought
5. Lab-Bench: Measuring capabilities of language models for biology research — J. M. Laurent, J. D. Janizek, M. Ruzo, M. M. Hinks, M. J. Hammerling, S. Narayanan, M. Ponnapati, A. D. White, S. G. Rodriques, 2024
https://scholar.google.com/scholar?q=Lab-Bench:+Measuring+capabilities+of+language+models+for+biology+research
6. First-Person Fairness in Chatbots — T. Eloundou, A. Beutel, D. G. Robinson, K. Gu-Lemberg, A.-L. Brakman, P. Mishkin, M. Shah, J. Heidecke, L. Weng, A. T. Kalai, 2024
https://scholar.google.com/scholar?q=First-Person+Fairness+in+Chatbots
7. The Berkeley Function Calling Leaderboard (BFCL): From tool use to agentic evaluation of large language models — S. G. Patil, H. Mao, F. Yan, C. C.-J. Ji, V. Suresh, I. Stoica, J. E. Gonzalez, 2025
https://scholar.google.com/scholar?q=The+Berkeley+Function+Calling+Leaderboard+(BFCL):+From+tool+use+to+agentic+evaluation+of+large+language+models
Interactive Visualization: GPT-5.6 System Card: Cybersecurity Rises, Critical Line Holds
