Brian Nosek is the cofounder and Executive Director of the Center for Open Science. He co-developed the Implicit Association Test, a method that advanced the study of implicit bias. He then co-founded three non-profit organizations: Project Implicit to advance research about implicit bias, the Society for the Improvement of Psychological Science to improve the research culture in his home discipline, and the Center for Open Science (COS) to improve rigor, transparency, integrity, and reproducibility across research disciplines. He led the Reproducibility Project in Psychology, a replication of 100 studies from psychology, as well as multiple other replication projects, along with policy reforms such as open science badges, and the investigation of prediction markets for study replication.
CONTACT RANDY:
Feedback: metasciencematters@gmail.com
EPISODE LINKS:
Estimating the reproducibility of psychological science (Reproducibility Project in Psychology led by Brian Nosek):
https://www.science.org/doi/10.1126/science.aac4716
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant:
https://journals.sagepub.com/doi/10.1177/0956797611417632
What is replication?:
https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3000691
Metascience conference:
https://metascience.info/
International Conference on the Science of Science and Innovation:
https://icssi.org/
International Congress on Peer Review and Scientific Publication:
https://peerreviewcongress.org/
MetaROR:
https://metaror.org/
OUTLINE:
0:00 - Introduction
2:56 - Brian's origin story as a psychologist
6:35 - Initial interest in metascience
10:57 - "Scientific Utopia," starting the Reproducibility Project in Psychology, and major fraud cases
17:57 - How did the Reproducibility Project in Psychology come together?
23:40 - Results of the Reproducibility Project in Psychology
27:03 - Response from the field, institutional changes
30:39 - Advice for high school/undergrad listeners
34:03 - Outro
