55. Angelika Stefan: p-hacking, simulations, and Shiny Apps

BJKS Podcast

Angelika Stefan is a PhD student at the University of Amsterdam in the Psychological Methods group (lead by Eric-Jan Wagenmakers). In this conversation, we talk about her preprint 'Big little lies: A Compendium and Simulation of p-Hacking Strategies', which she just uploaded to PsyArXiv. We also discuss how she created the Shiny App that allows users to play around with the simulations and run simulations that didn't make it into the paper.
BJKS Podcast is a podcast about neuroscience, psychology, and anything vaguely related, hosted by Benjamin James Kuper-Smith. In 2022, episodes will appear irregularly, roughly twice per month. You can find the podcast on all podcasting platforms (e.g., Spotify, Apple/Google Podcasts, etc.).
Timestamps
00:05: How did Angelika start working on her paper 'Big little lies'
05:22: P-hacking and human error
07:47: Different p-hacking strategies
29:34: What are good solutions against p-hacking?
40:56: Future directions for this kind of research
45:32: How to make a Shiny Apps
Podcast links

• Website: https://geni.us/bjks-pod
• Twitter: https://geni.us/bjks-pod-twt

Angelika's links

• Google Scholar: https://geni.us/stefan-scholar
• Twitter: https://geni.us/stefan-twt

Ben's links

• Website: https://geni.us/bjks-web
• Google Scholar: https://geni.us/bjks-scholar
• Twitter: https://geni.us/bjks-twt

References and links

• Stefan, A., & Schönbrodt, F. D. (2022, March 16). Big Little Lies: A Compendium and Simulation of p-Hacking Strategies. https://doi.org/10.31234/osf.io/xy2dk
• Wicherts, J. M., Veldkamp, C. L. S., Augusteijn, H. E. M., Bakker, M., van Aert, R. C. M., & van Assen, M. A. L. M. (2016). Degrees of freedom in planning, running, analyzing, and reporting psychological studies: A checklist to avoid p-hacking. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.01832
• Their Shiny App: https://shiny.psy.lmu.de/felix/ShinyPHack/
• Shiny tutorial videos: https://shiny.rstudio.com/tutorial/
• As Predicted preregistration template: https://aspredicted.org/

Chapters

1. 55. Angelika Stefan: p-hacking, simulations, and Shiny Apps (00:00:00)

2. How did Angelika start working on her paper 'Big little lies' (00:00:05)

3. P-hacking and human error (00:05:22)

4. Different p-hacking strategies (00:07:47)

5. What are good solutions against p-hacking? (00:29:34)

6. Future directions for this kind of research (00:40:56)

7. How to make a Shiny Apps (00:45:32)