92. Tom Hardwicke: Meta-research, reproducibility, and post-publication critique

BJKS Podcast

Tom Hardwicke is a Research Fellow at the University of Melbourne. We talk about meta-science, incuding Tom's work on post-publication critique and registered reports, what his new role as editor at Psychological Science entails, and much more.
BJKS Podcast is a podcast about neuroscience, psychology, and anything vaguely related, hosted by Benjamin James Kuper-Smith.
Support the show: https://geni.us/bjks-patreon
Timestamps
0:00:00: What is meta-science/meta-research?
0:03:15: How Tom got involved in meta-science
0:21:51: Post-publication critique in journals
0:39:30: How Tom's work (registered reports) led to policy changes at journals
0:44:08: Tom is now the STAR (statistics, transparency, and rigor) editor at Psychological Science
0:48:17: How to best share data that can be used by people with different backgrounds
0:54:51: A book or paper more people should read
0:56:36: Something Tom wishes he'd learnt sooner
1:00:13: Jobs in meta-science
1:03:29: Advice for PhD students/postdocs
Podcast links

• Website: https://geni.us/bjks-pod
• Twitter: https://geni.us/bjks-pod-twt

Tom's links

• Website: https://geni.us/hardwicke-web
• Google Scholar: https://geni.us/hardwicke-scholar
• Twitter: https://geni.us/hardwicke-twt

Ben's links

• Website: https://geni.us/bjks-web
• Google Scholar: https://geni.us/bjks-scholar
• Twitter: https://geni.us/bjks-twt

References & links
Episodes w/ Nosek, Vazire, & Chambers:
https://geni.us/bjks-nosek
https://geni.us/bjks-vazire
https://geni.us/bjks-chambers
Foamhenge: https://en.wikipedia.org/wiki/Foamhenge
METRICS: https://metrics.stanford.edu/
AIMOS: https://www.youtube.com/@aimosinc4164
Chambers & Mellor (2018). Protocol transparency is vital for registered reports. Nature Human Behaviour.
Hardwicke, Jameel, Jones, Walczak & Weinberg (2014). Only human: Scientists, systems, and suspect statistics. Opticon1826.
Hardwicke & Ioannidis (2018). Mapping the universe of registered reports. Nature Human Behaviour.
Hardwicke, Serghiou, Janiaud, Danchev, Crüwell, Goodman & Ioannidis (2020). Calibrating the scientific ecosystem through meta-research. Annual Review of Statistics and Its Application.
Hardwicke, Thibault, Kosie, Tzavella, Bendixen, Handcock, ... & Ioannidis (2022). Post-publication critique at top-ranked journals across scientific disciplines: a cross-sectional assessment of policies and practice. Royal Society Open Science.
Hardwicke & Vazire (2023). Transparency Is Now the Default at Psychological Science. Psychological Science.
Kidwell, Lazarević, Baranski, Hardwicke, Piechowski, Falkenberg, ... & Nosek (2016). Badges to acknowledge open practices: A simple, low-cost, effective method for increasing transparency. PLoS biology.
Nosek, Hardwicke, Moshontz, Allard, Corker, Dreber, ... & Vazire (2022). Replicability, robustness, and reproducibility in psychological science. Annual review of psychology.
Ritchie (2020). Science fictions: Exposing fraud, bias, negligence and hype in science.

Chapters

1. What is meta-science/meta-research? (00:00:00)

2. How Tom got involved in meta-science (00:03:15)

3. Post-publication critique in journals (00:21:51)

4. How Tom's work (registered reports) led to policy changes at journals (00:39:30)

5. Tom is now the STAR (statistics, transparency, and rigor) editor at Psychological Science (00:44:08)

6. How to best share data that can be used by people with different backgrounds (00:48:17)

7. A book or paper more people should read (00:54:51)

8. Something Tom wishes he'd learnt sooner (00:56:36)

9. Jobs in meta-science (01:00:13)

10. Advice for PhD students/postdocs (01:03:29)