This episode examines a 2026 ICLR paper that asks whether groups of LLM agents form genuine collectives or are just aggregates of individuals. Ten GPT-4.1 agents play a group binary search game, each privately guessing a number so the total hits a hidden target while seeing only "too high" or "too low" feedback. The only way to succeed is to take complementary offsets, since identical strategies make the group overshoot and undershoot in a loop. The hosts explain partial information decomposition, which splits information into unique, redundant, and synergistic parts. They note that the results depend on which redundancy definition is chosen, and that the leading alternative measure isn't reported. They also walk through the three prompt conditions (plain, persona, and persona plus a one-sentence theory-of-mind nudge), the emergence and coalition tests applied to short trajectories, and the statistical tension between Fisher's method and Wilcoxon tests. Listeners get a skeptical look at how much evidence supports the claim that prompting can turn a group of agents into a higher-order collective.
Sources:
1. Emergent Coordination in Multi-Agent Language Models — Christoph Riedl, 2025
http://arxiv.org/abs/2510.05174
2. Nonnegative Decomposition of Multivariate Information — Paul L. Williams, Randall D. Beer, 2010
https://scholar.google.com/scholar?q=Nonnegative+Decomposition+of+Multivariate+Information
3. Reconciling emergences: An information-theoretic approach to identify causal emergence in multivariate data — Fernando E. Rosas, Pedro A. M. Mediano, Henrik J. Jensen, Anil K. Seth, Adam B. Barrett, Robin L. Carhart-Harris, Daniel Bor, 2020
https://scholar.google.com/scholar?q=Reconciling+emergences%3A+An+information-theoretic+approach+to+identify+causal+emergence+in+multivariate+data
4. Greater than the parts: a review of the information decomposition approach to causal emergence — Pedro A. M. Mediano, Fernando E. Rosas, Andrea I. Luppi, Robin L. Carhart-Harris, Daniel Bor, Anil K. Seth, Adam B. Barrett, 2022
https://scholar.google.com/scholar?q=Greater+than+the+parts%3A+a+review+of+the+information+decomposition+approach+to+causal+emergence
5. Quantifying High-order Interdependencies via Multivariate Extensions of the Mutual Information — Fernando E. Rosas, Pedro A. M. Mediano, Michael Gastpar, Henrik J. Jensen, 2019
https://scholar.google.com/scholar?q=Quantifying+High-order+Interdependencies+via+Multivariate+Extensions+of+the+Mutual+Information
6. AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation — Qingyun Wu, Gagan Bansal, Jieyu Zhang, et al., 2023
https://scholar.google.com/scholar?q=AutoGen%3A+Enabling+Next-Gen+LLM+Applications+via+Multi-Agent+Conversation
7. MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework — Sirui Hong, Mingchen Zhuge, Jonathan Chen, et al., 2024 (preprint 2023)
https://scholar.google.com/scholar?q=MetaGPT%3A+Meta+Programming+for+A+Multi-Agent+Collaborative+Framework
8. AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors — Weize Chen, Yusheng Su, Jingwei Zuo, et al., 2023
https://scholar.google.com/scholar?q=AgentVerse%3A+Facilitating+Multi-Agent+Collaboration+and+Exploring+Emergent+Behaviors
9. Evidence for a Collective Intelligence Factor in the Performance of Human Groups — Anita Williams Woolley, Christopher F. Chabris, Alex Pentland, Nada Hashmi, Thomas W. Malone, 2010
https://scholar.google.com/scholar?q=Evidence+for+a+Collective+Intelligence+Factor+in+the+Performance+of+Human+Groups
10. Machine Theory of Mind — Neil C. Rabinowitz, Frank Perbet, H. Francis Song, Chiyuan Zhang, S. M. Ali Eslami, Matthew Botvinick, 2018
https://scholar.google.com/scholar?q=Machine+Theory+of+Mind
11. Theory of Mind May Have Spontaneously Emerged in Large Language Models — Michal Kosinski, 2023
https://scholar.google.com/scholar?q=Theory+of+Mind+May+Have+Spontaneously+Emerged+in+Large+Language+Models
12. Generative Agents: Interactive Simulacra of Human Behavior — Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein, 2023
https://scholar.google.com/scholar?q=Generative+Agents%3A+Interactive+Simulacra+of+Human+Behavior
13. Human-level play in the game of Diplomacy by combining language models with strategic reasoning (Cicero) — Meta Fundamental AI Research Diplomacy Team (FAIR) et al., 2022
https://scholar.google.com/scholar?q=Human-level+play+in+the+game+of+Diplomacy+by+combining+language+models+with+strategic+reasoning+%28Cicero%29
14. Williams, P. L., & Beer, R. D. Nonnegative decomposition of multivariate information — Paul L. Williams, Randall D. Beer, 2010
https://scholar.google.com/scholar?q=Williams%2C+P.+L.%2C+%26+Beer%2C+R.+D.+Nonnegative+decomposition+of+multivariate+information
15. Quantifying unique information — Nils Bertschinger, Johannes Rauh, Eckehard Olbrich, Jürgen Jost, Nihat Ay, 2014
https://scholar.google.com/scholar?q=Quantifying+unique+information
16. Toward a unified taxonomy of information dynamics via integrated information decomposition (ΦID) — Pedro A. M. Mediano, Fernando E. Rosas, Andrea I. Luppi, et al., 2025
https://scholar.google.com/scholar?q=Toward+a+unified+taxonomy+of+information+dynamics+via+integrated+information+decomposition+%28%CE%A6ID%29
17. The emergence of specialized roles within groups — Robert L. Goldstone, Edgar J. Andrade-Lotero, Robert D. Hawkins, Michael E. Roberts, 2024
https://scholar.google.com/scholar?q=The+emergence+of+specialized+roles+within+groups
18. Quantifying collective intelligence in human groups — Christoph Riedl, Young Ji Kim, Pranav Gupta, Thomas W. Malone, Anita Williams Woolley, 2021
https://scholar.google.com/scholar?q=Quantifying+collective+intelligence+in+human+groups
19. Why do multi-agent LLM systems fail? — Mert Cemri et al., 2025
https://scholar.google.com/scholar?q=Why+do+multi-agent+LLM+systems+fail%3F
20. Emergent social conventions and collective bias in LLM populations — Ariel Flint Ashery, Luca Maria Aiello, Andrea Baronchelli, 2025
https://scholar.google.com/scholar?q=Emergent+social+conventions+and+collective+bias+in+LLM+populations
21. Corrupted by reasoning: Reasoning language models become free-riders in public goods games — David Guzman Piedrahita, Yongjin Yang, Mrinmaya Sachan, Giorgia Ramponi, Bernhard Schölkopf, Zhijing Jin, 2025
https://scholar.google.com/scholar?q=Corrupted+by+reasoning%3A+Reasoning+language+models+become+free-riders+in+public+goods+games
22. Clever Hans or neural theory of mind? Stress testing social reasoning in large language models — Natalie Shapira, Mosh Levy, Seyed Hossein Alavi, Xuhui Zhou, Yejin Choi, Yoav Goldberg, Maarten Sap, Vered Shwartz, 2024
https://scholar.google.com/scholar?q=Clever+Hans+or+neural+theory+of+mind%3F+Stress+testing+social+reasoning+in+large+language+models
23. More agents is all you need — Junyou Li, Qin Zhang, Yangbin Yu, Qiang Fu, Deheng Ye, 2024
https://scholar.google.com/scholar?q=More+agents+is+all+you+need
Interactive Visualization: Measuring Emergent Coordination in Multi-Agent LLMs via Information Decomposition
