Episode 9: Praeiudicium Publicandi

Nullius in Verba

In this episode, we discuss the issue of publication bias. We discuss issues like: Do we learn anything from null results, given the current state of research practices? Is poorly done research still worth sharing with the scientific community? And how can we move toward a system where null results are informative and worth publishing?

Shownotes

• Bones, A. K. (2012). We Knew the Future All Along Scientific Hypothesizing is Much More Accurate Than Other Forms of Precognition—A Satire in One Part. Perspectives on Psychological Science, 7(3), 307–309. https://doi.org/10.1177/1745691612441216

• Carter, E. C., & McCullough, M. E. (2014). Publication bias and the limited strength model of self-control: Has the evidence for ego depletion been overestimated? Frontiers in Psychology, 5. https://doi.org/10.3389/fpsyg.2014.00823

• Greenwald, A. G. (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82(1), 1–20. https://doi.org/10.1037/h0076157

• Fidler, F., Singleton Thorn, F., Barnett, A., Kambouris, S., & Kruger, A. (2018). The epistemic importance of establishing the absence of an effect. Advances in Methods and Practices in Psychological Science, 1(2), 237-244.

• Pickett, J. T., & Roche, S. P. (2017). Questionable, Objectionable or Criminal? Public Opinion on Data Fraud and Selective Reporting in Science. Science and Engineering Ethics, 1–21. https://doi.org/10.1007/s11948-017-9886-2

• Scheel, A. M., Schijen, M. R. M. J., & Lakens, D. (2021). An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports. Advances in Methods and Practices in Psychological Science, 4(2), 25152459211007468. https://doi.org/10.1177/25152459211007467

• Sterling, T. D. (1959). Publication Decisions and Their Possible Effects on Inferences Drawn from Tests of Significance—Or Vice Versa. Journal of the American Statistical Association, 54(285), 30–34. JSTOR. https://doi.org/10.2307/2282137

• The FDA Trial tracker to see which trials have not shared their results: https://fdaaa.trialstracker.net/