S6E13 - Stop Running A/B Tests One at a Time

High-velocity experimentation can dramatically increase how quickly organizations learn, optimize their products, and drive revenue. But many teams still run A/B tests sequentially, waiting for one experiment to finish before starting the next.

In this video, Varun, co-founder of Geeks of Digital, explains how overlapping A/B tests can remove experimentation bottlenecks while still maintaining rigorous randomization and measurement.

You’ll learn how layered experimentation works, why the "isolation fallacy" can hold teams back, when experiments should still be isolated, and how organizations can build an operational system for running experiments at scale.

The video also covers the "blue-by-blue" isolation trap, compounding gains from multiple winning experiments, fake door testing, experimentation culture, and how companies like Meta, Booking.com, Airbnb, and Spotify approach experimentation.

---

Music: “Strong Female Pop Attitude” by JuicyLucyMusic, licensed via AudioJungle/Envato Market.https://audiojungle.net/item/strong-pop-attitude/19345362

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com