As product lead at Anthropic, Jess has a first-hand look at how Anthropic teams are moving from prompting AI to building long-running agents that work overnight. In our episode, Jess showed me how to build a Claude analytics agent from scratch, then covered how Anthropic PMs use agents internally to understand the codebase, monitor customer feedback, and make better product decisions.
Jess and I talked about:
(00:00) AI agents that work while you sleep
(03:46) Claude Managed Agents help for long-running tasks
(05:22) Demo: Building a Claude analyst agent from scratch
(09:28) Traces: How to see where an agent got stuck
(15:08) Evals: How agents grade their own work
(20:16) 5 ways in which Anthropic PMs use agents internally
(28:06) Processing a 4,000-company waitlist with agents
(32:47) To build your first agent, focus on helping one person
(36:47) What changes when agents can work overnight
Thanks to our sponsors:
Linear: The AI agent platform for modern teams https://linear.app/behind-the-craft
Wispr Flow: 4x faster than typing with your voice https://ref.wisprflow.ai/peteryang
Riverside: All-in-one AI studio for podcasts and video https://creators.riverside.com/PeterYang
📌 Get the takeaways: https://creatoreconomy.so/p/inside-anthropics-bet-on-claude-agents-jess-yan
📌 Get my personal AI operating system with all my skills and prompts: https://www.behindthecraft.com/
Where to find Jess:
X: https://x.com/jess__yan
Website: https://platform.claude.com/docs/en/managed-agents/overviewSubscribe to this channel - more interviews coming soon!
