This episode explores the Darwin Gödel Machine, a self-improving coding agent from researchers at UBC, the Vector Institute, Sakana AI, and Jeff Clune's lab, published on arXiv in May 2025 and accepted to ICLR 2026. It traces the paper's lineage back to Schmidhuber's 2007 theoretical Gödel Machine, explaining how this work swaps the impossible requirement of formal proof for empirical validation — testing each self-modification against real coding benchmarks instead. The discussion covers open-ended evolution, drawing on Lehman and Stanley's novelty search and Mouret and Clune's MAP-Elites work, and why the system keeps an archive of "interesting" mutant agents rather than discarding all but the best performer. Concrete results are highlighted: the self-modifying agent, starting from a bare-bones Claude 3.5 Sonnet with just two tools, more than doubled its own performance, jumping from 20% to 50% on SWE-bench and from 14.2% to 30.7% on Polyglot. Listeners interested in AI safety, recursive self-improvement, and the practical realization of a two-decade-old theoretical idea will find the episode's blend of technical lineage and hard numbers compelling.
Sources:
1. Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents — Jenny Zhang, Shengran Hu, Cong Lu, Robert Lange, Jeff Clune, 2025
http://arxiv.org/abs/2505.22954
2. Abandoning Objectives: Evolution Through the Search for Novelty Alone — Joel Lehman, Kenneth O. Stanley, 2011
https://scholar.google.com/scholar?q=Abandoning+Objectives:+Evolution+Through+the+Search+for+Novelty+Alone
3. Illuminating Search Spaces by Mapping Elites — Jean-Baptiste Mouret, Jeff Clune, 2015
https://scholar.google.com/scholar?q=Illuminating+Search+Spaces+by+Mapping+Elites
4. Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutions — Rui Wang, Joel Lehman, Jeff Clune, Kenneth O. Stanley, 2019
https://scholar.google.com/scholar?q=Paired+Open-Ended+Trailblazer+(POET):+Endlessly+Generating+Increasingly+Complex+and+Diverse+Learning+Environments+and+Their+Solutions
5. Quality Diversity: A New Frontier for Evolutionary Computation — Justin K. Pugh, Lisa B. Soros, Kenneth O. Stanley, 2016
https://scholar.google.com/scholar?q=Quality+Diversity:+A+New+Frontier+for+Evolutionary+Computation
6. The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery — Chris Lu, Cong Lu, Robert Tjarko Lange, Jakob Foerster, Jeff Clune, David Ha, 2024
https://scholar.google.com/scholar?q=The+AI+Scientist:+Towards+Fully+Automated+Open-Ended+Scientific+Discovery
7. SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering — John Yang, Carlos E. Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, Ofir Press, 2024
https://scholar.google.com/scholar?q=SWE-agent:+Agent-Computer+Interfaces+Enable+Automated+Software+Engineering
8. Mathematical discoveries from program search with large language models (FunSearch) — Bernardino Romera-Paredes, Mohammadamin Barekatain, Alexander Novikov, et al., 2024
https://scholar.google.com/scholar?q=Mathematical+discoveries+from+program+search+with+large+language+models+(FunSearch)
9. Voyager: An Open-Ended Embodied Agent with Large Language Models — Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, Anima Anandkumar, 2023
https://scholar.google.com/scholar?q=Voyager:+An+Open-Ended+Embodied+Agent+with+Large+Language+Models
10. Specification gaming: the flip side of AI ingenuity — Victoria Krakovna, Jonathan Uesato, Vladimir Mikulik, et al. (DeepMind), 2020
https://scholar.google.com/scholar?q=Specification+gaming:+the+flip+side+of+AI+ingenuity
Interactive Visualization: Darwin Gödel Machine: Self-Improving Coding Agents Through Open-Ended Evolution
