This episode examines MAGMA, a memory architecture for long-running AI agents that stores each event once and links it across four separate graphs: semantic, temporal, causal, and entity. Retrieval follows whichever edge type a question calls for. The discussion first sets out why bigger context windows don't solve the problem, then traces the shift from long-context models to RAG to agent-owned memory systems such as MemGPT, A-Mem, and Zep. It argues that these systems organize memory by similarity rather than by dependency, so they struggle with "why" and "what came before" questions. The hosts also describe the LoCoMo and LongMemEval benchmarks, point out that MAGMA is a data structure around a frozen LLM rather than a trained network, and note that the extra write-time LLM extraction (especially for causal edges) raises the question of whether the headline gains come from the graph or from the surrounding prompts. Listeners get a skeptical look at what the paper's single headline number actually measures, and at which comparisons, such as Mem0 and HippoRAG 2, the paper cites but doesn't run.
Sources:
1. MAGMA: A Multi-Graph based Agentic Memory Architecture for AI Agents — Dongming Jiang, Yi Li, Guanpeng Li, Bingzhe Li, 2026
http://arxiv.org/abs/2601.03236
2. MemGPT: Towards LLMs as Operating Systems — Charles Packer, Sarah Wooders, Kevin Lin, Vivian Fang, Shishir G. Patil, Ion Stoica, Joseph E. Gonzalez, 2023
https://scholar.google.com/scholar?q=MemGPT%3A+Towards+LLMs+as+Operating+Systems
3. Generative Agents: Interactive Simulacra of Human Behavior — Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein, 2023
https://scholar.google.com/scholar?q=Generative+Agents%3A+Interactive+Simulacra+of+Human+Behavior
4. Zep: A Temporal Knowledge Graph Architecture for Agent Memory — Preston Rasmussen, Pavlo Paliychuk, Travis Beauvais, Jack Ryan, Daniel Chalef, 2025
https://scholar.google.com/scholar?q=Zep%3A+A+Temporal+Knowledge+Graph+Architecture+for+Agent+Memory
5. A-Mem: Agentic Memory for LLM Agents — Wujiang Xu, Zujie Liang, Kai Mei, Hang Gao, Juntao Tan, Yongfeng Zhang, 2025
https://scholar.google.com/scholar?q=A-Mem%3A+Agentic+Memory+for+LLM+Agents
6. Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory — Prateek Chhikara, Dev Khant, Saket Aryan, Taranjeet Singh, Deshraj Yadav, 2025
https://scholar.google.com/scholar?q=Mem0%3A+Building+Production-Ready+AI+Agents+with+Scalable+Long-Term+Memory
7. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks — Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Douwe Kiela and others, 2020
https://scholar.google.com/scholar?q=Retrieval-Augmented+Generation+for+Knowledge-Intensive+NLP+Tasks
8. Evaluating Very Long-Term Conversational Memory of LLM Agents (LoCoMo) — Adyasha Maharana, Dong-Ho Lee, Sergey Tulyakov, Mohit Bansal, Francesco Barbieri, Yuwei Fang, 2024
https://scholar.google.com/scholar?q=Evaluating+Very+Long-Term+Conversational+Memory+of+LLM+Agents+%28LoCoMo%29
9. LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory — Di Wu, Hongwei Wang, Wenhao Yu, Yuwei Zhang, Kai-Wei Chang, Dong Yu, 2024
https://scholar.google.com/scholar?q=LongMemEval%3A+Benchmarking+Chat+Assistants+on+Long-Term+Interactive+Memory
10. A Survey on the Memory Mechanism of Large Language Model based Agents — Zeyu Zhang, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen and others, 2024
https://scholar.google.com/scholar?q=A+Survey+on+the+Memory+Mechanism+of+Large+Language+Model+based+Agents
11. From Local to Global: A Graph RAG Approach to Query-Focused Summarization — Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, Jonathan Larson, 2024
https://scholar.google.com/scholar?q=From+Local+to+Global%3A+A+Graph+RAG+Approach+to+Query-Focused+Summarization
12. HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models — Bernal Jiménez Gutiérrez, Yiheng Shu, Yu Gu, Michihiro Yasunaga, Yu Su, 2024
https://scholar.google.com/scholar?q=HippoRAG%3A+Neurobiologically+Inspired+Long-Term+Memory+for+Large+Language+Models
13. Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph — Jiashuo Sun, Chengjin Xu, Lumingyi Tang, Saizhuo Wang, Chen Lin, Yeyun Gong, Lionel M. Ni, Heung-Yeung Shum, Jian Guo, 2023
https://scholar.google.com/scholar?q=Think-on-Graph%3A+Deep+and+Responsible+Reasoning+of+Large+Language+Model+on+Knowledge+Graph
14. Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learning (MINERVA) — Rajarshi Das, Shehzaad Dhuliawala, Manzil Zaheer, Luke Vilnis, Ishan Durugkar, Akshay Krishnamurthy, Alex Smola, Andrew McCallum, 2018
https://scholar.google.com/scholar?q=Go+for+a+Walk+and+Arrive+at+the+Answer%3A+Reasoning+Over+Paths+in+Knowledge+Bases+using+Reinforcement+Learning+%28MINERVA%29
15. Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory (including Mem0^g graph variant) — Chhikara, Khant, Aryan, Singh, Yadav, 2025
https://scholar.google.com/scholar?q=Mem0%3A+Building+Production-Ready+AI+Agents+with+Scalable+Long-Term+Memory+%28including+Mem0%5Eg+graph+variant%29
16. HippoRAG 2 / From RAG to Memory: Non-Parametric Continual Learning for LLMs — Gutiérrez, Shu, Qi, Zhou, Su, 2025
https://scholar.google.com/scholar?q=HippoRAG+2+%2F+From+RAG+to+Memory%3A+Non-Parametric+Continual+Learning+for+LLMs
17. Nemori: Self-Organizing Agent Memory Inspired by Cognitive Science — Nan, Ma, Wu, Chen, 2025
https://scholar.google.com/scholar?q=Nemori%3A+Self-Organizing+Agent+Memory+Inspired+by+Cognitive+Science
18. Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations — Jiang, Li, Wei, et al., 2026
https://scholar.google.com/scholar?q=Anatomy+of+Agentic+Memory%3A+Taxonomy+and+Empirical+Analysis+of+Evaluation+and+System+Limitations
19. Memory in the Age of AI Agents (survey) — Hu et al., 2025
https://scholar.google.com/scholar?q=Memory+in+the+Age+of+AI+Agents+%28survey%29
20. Think-on-Graph: Deep and Responsible Reasoning of LLMs on Knowledge Graph — Sun et al., 2024
https://scholar.google.com/scholar?q=Think-on-Graph%3A+Deep+and+Responsible+Reasoning+of+LLMs+on+Knowledge+Graph
21. Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena — Zheng et al., 2023
https://scholar.google.com/scholar?q=Judging+LLM-as-a-Judge+with+MT-Bench+and+Chatbot+Arena
Interactive Visualization: MAGMA: Multi-Graph Agentic Memory for Long-Horizon AI Agents
