Ben Morss is a Developer Advocate at Mistral. He previously spent 9.5 years at Google as a Product Manager for advanced APIs in Chrome and a Developer Advocate for the web. He earned a bachelor's degree in Computer Science and Music from Harvard University and a doctorate in Music Composition from the University of California at Davis. He continues to make music and write about music theory.

Dan and Ben discuss how LLMs help people learn while still missing context and intent. Their discussion of information theory and training data leads into a debate about software craft when agents make code much cheaper to produce. Ben describes Chat Invaders, a cat-themed demo game, and a reunion sing-along app that broke with forty people present. He had not load-tested the app and did not determine what caused the failure.

They explore why working output does not guarantee value for a business or an audience. Ben wants musical assistance that can develop ideas and handle arranging work, but finds music theory explanations unreliable. The conversation ends with the human experience behind fiction and songs, and open questions about whether models could be conscious.

Full episode notes

Transcript

Chapters

  • (00:00) - Learning with LLMs and the limits of explanation
  • (05:24) - Model progress and conversational regressions
  • (09:02) - Keeping up with AI and understanding the mechanics
  • (11:10) - Information theory, entropy, and model compression
  • (19:19) - Computing, music, and understanding structure
  • (23:35) - Software craft versus speed of iteration
  • (30:55) - Vibe coding and educational sample code
  • (34:22) - The sing-along app that broke live
  • (37:38) - Software demand and the power of verification
  • (40:58) - Human judgment and useful business adoption
  • (48:47) - AI composition and the missing musical assistant
  • (52:38) - Music theory and gaps in training data
  • (59:31) - Fiction, music, and the human behind the work
  • (01:05:14) - Thinking, consciousness, and continuity

⠀

Links from the show

--------------------

⠀

Guests

-------

Ben Morss, Developer Advocate, Mistral

⠀

Follow the podcast

-------------------

⠀

Follow Dan Gerlanc

-------------------

Podden och tillhörande omslagsbild på den här sidan tillhör Dan Gerlanc. Innehållet i podden är skapat av Dan Gerlanc och inte av, eller tillsammans med, Poddtoppen.