How do you teach a model the difference between helpful and harmful when it has no inherent sense of either? This episode dives into Constitutional AI, Anthropic's framework for training AI systems to be both useful and safe by giving them an explicit set of principles to reason from. It's a fascinating look at how alignment research is evolving beyond simple human feedback — and what it means to give an AI something like a conscience.
Links:
Anthropic, "Constitutional AI: Harmlessness from AI Feedback" (2022)
https://arxiv.org/abs/2212.08073
Podden och tillhörande omslagsbild på den här sidan tillhör
Katie Malone. Innehållet i podden är skapat av Katie Malone och inte av,
eller tillsammans med, Poddtoppen.
