Local Models

Today we get our hands dirty running AI language models on our very own (and very hot) laptop!

Exploring the tradeoffs, we see how this approach addresses common AI objections including privacy and resource usage. Local AI is a promising path, though still a bit tricky to get up and running.

Concepts

• AI Ethics
• Open weight models
• Model size

References

• LM Studio
• Local LLMs are getting easier - 2026 guide by Sitepoint
• Eliza web version
• Gemma models by Google DeepMind
• Llama models by Meta
• Local AI coding is finally good enough - video by Forrest Knight
• Pydantic AI Python library including web chat UI

Hosted by Ray Myers and Liz Martinez. Find us online at thecodingagency.org.