Go offline with the Player FM app!
Episode 104: Quantifying the Narrative of Replicable Science
Manage episode 359277705 series 2313502
Yoel and Alexa discuss a recent paper that takes a machine learning approach to estimating the replicability of psychology as a discipline. The researchers' investigation begins with a training process, in which an artificial intelligence model identifies ways that textual descriptions differ for studies that pass versus fail manual replication tests. This model is then applied to a set of 14,126 papers published in six well-known psychology journals over the past 20 years, picking up on the textual markers that it now recognizes as signals of replicable findings. In a mysterious twist, these markers remain hidden in the black box of the algorithm. However, the researchers hand-examine a few markers of their own, testing whether things like subfield, author expertise, and media interest are associated with the replicability of findings. And, as if machine learning models weren't juicy enough, Yoel trolls Alexa with an intro topic hand-selected to infuriate her.
Links:
- Two Psychologists Four Beers on Untappd
- A discipline-wide investigation of the replicability of Psychology papers over the past two decades | PNAS
- Best-Selling Author & Harvard Professor Steven Pinker Will Transform His Ideas into NFTs | Blockster
- Are NFTs a Good Investment? | MoneyUnder30
- Miss Grit - Like You (Lyric Video) - YouTube
112 episodes
Manage episode 359277705 series 2313502
Yoel and Alexa discuss a recent paper that takes a machine learning approach to estimating the replicability of psychology as a discipline. The researchers' investigation begins with a training process, in which an artificial intelligence model identifies ways that textual descriptions differ for studies that pass versus fail manual replication tests. This model is then applied to a set of 14,126 papers published in six well-known psychology journals over the past 20 years, picking up on the textual markers that it now recognizes as signals of replicable findings. In a mysterious twist, these markers remain hidden in the black box of the algorithm. However, the researchers hand-examine a few markers of their own, testing whether things like subfield, author expertise, and media interest are associated with the replicability of findings. And, as if machine learning models weren't juicy enough, Yoel trolls Alexa with an intro topic hand-selected to infuriate her.
Links:
- Two Psychologists Four Beers on Untappd
- A discipline-wide investigation of the replicability of Psychology papers over the past two decades | PNAS
- Best-Selling Author & Harvard Professor Steven Pinker Will Transform His Ideas into NFTs | Blockster
- Are NFTs a Good Investment? | MoneyUnder30
- Miss Grit - Like You (Lyric Video) - YouTube
112 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.