Today, Sarah, Will and Jan sit down to discuss the last season of ReproducibiliTea. We talk about Will's terrible terrible taste in puns, Jan's terrible taste in pizza, and Sarah's fall into FORRT(.org).While we are wrapping up Season 3, stay tuned for a few more fun & exciting episodes we have planned for this year!Not many footnotes this time:Sar…

Today, Will sits down with Max Korbmacher, Thomas Rhys Evans, and Flavio Azevedo, some of the authors of the paper "The replication crisis has led to positive structural, procedural, and community changes" to talk about the paper, FORRT, and Open Science communities.Show notes:The paper we discuss for this episode: Korbmacher, M., Azevedo, F., Penn…

Today, Will talks to David Reinstein about scientific publishing and The Unjournal.The Unjournal: https://www.unjournal.orgThe Unjournal on LinkedIn: https://www.linkedin.com/company/unjournal/To get the latest updates: https://bit.ly/ujupdatesTo apply for positions at the Unjournal: https://bit.ly/UjworkWill and David’s extended notes for the epis…

Today, Will sits down with Björn Jorges and Sabrina Hansmann-Roth to discuss the role of academic societies in the science reform movement.The poster session: https://www.visionsciences.org/2023-pre-data-collection-poster-session-satellite/Korbmacher, M., Azevedo, F., Pennington, C., Hartmann, H., Pownall, M., Schmidt, K., ... & Evans, T. (2023). T…

Today Sarah chats to Zoltan Dienes Live from SIPS!Zoltan's keynote: https://www.youtube.com/watch?v=BxdGXLOC1CcReviewing labor: https://researchintegrityjournal.biomedcentral.com/articles/10.1186/s41073-021-00118-2?ref=refindPeer Community In Registered Reports: https://rr.peercommunityin.org/Flourishing Science Think Tank paper: https://mindrxiv.o…

Today, Sarah is joined by Agata Bochynska and Matthew Good from the University of Oslo's Open Research Team to talk about how vital libraries are to Open Science.Links from this episode:QualiFAIR: https://www.uv.uio.no/ils/english/about/organization/tlvlab/qualifair/ TIER2: https://tier2-project.eu/ Carpentries: https://carpentries.org/ Reproducibi…

Today, Sarah and Will discuss the invisible workload of making open science.The paper on invisible workload: https://journal.trialanderror.org/pub/the-invisible-workload/release/1The replication crisis has led to positive structural, procedural, and community changes: https://osf.io/r6cvx/For more info go to ReproducibiliTea.orgFor comments, questi…

Today special guest Nora Serres talks with Sarah Sauve about Registered Report and how cool Bayesian statistics are.Show notes:Appetezer paper: Bayes factor design analysis: Planning for compelling evidence https://link.springer.com/article/10.3758/s13423-017-1230-yNora’s thesis: https://www.duo.uio.no/bitstream/handle/10852/95323/5/Master-thesis_N…

Today, Will and Jan sit down with special guest and author of the paper "A large-scale study on research code quality and execution" Ana Trisovic to talk about the reproducibility of analysis code. Also windows.Links from this episode:Ana's paper: https://www.nature.com/articles/s41597-022-01143-6Gratitude package: https://github.com/Pakillo/gratef…

! Important Update !Since recording, UCU have announced that they will "ringfence £250,000 for members facing deductions for undertaking forms of ASOS, including the marking and assessment boycott." This is reassuring news for workers at universities where the VCs have threatened 50-100% pay deductions. But still no new offers from employers.Today,…

Will, Helena and Jan talk about how we assess research and that it is weird we never really learned how to do Peer Review.Papers we discussed:Responsible Research Assessment Should Prioritize Theory Development and Testing Over Ticking Open Science Boxes: https://psyarxiv.com/ad74m/A consensus-based tool for evaluating threats to the validity of em…

We mentioned lots of resources this week, brace yourselves!Books that changed our worldsHow To Read a Paper: The Basics of Evidence-Based Medicine by Trisha Greenhalghhttps://www.amazon.co.uk/How-Read-Paper-Evidence-Based-Medicine/dp/1444334360How to Win Campaigns by Chris Rosehttps://www.amazon.co.uk/How-Win-Campaigns-Steps-Success/dp/1853839620Po…

We are back!And we brought... a whole list of reading recommendations!Hosted and Produced by @Sarah_Sauve, @Will_Ngiam, and @VornhagenJB@hci.socialEdited by Jan VornhagenFor more information visit ReproducibiliTea.org and send your feedback here: https://forms.gle/8nNLZ92YUcU1mGhc6. For a transcript, please refer to our youtube video: https://youtu…

Sophia and Jan serendipitously meet at a conference and immediately drag special guests @lonnibesancon, @lahariG, Wesley Willett into a room to talk about transparency, Open Science and Human-Computer Interaction.For more Infos about the seminar visit https://www.dagstuhl.de/en/program/calendar/semhp/?semnr=22392Or go to ReproducibiliTea.orgIf you …

Today, Sam and Will have choice words about a website.For more Infos go to ReproducibiliTea.orgIf you have questions or comments, throw them into the pot: forms.gle/HXHHvrNHn54MVHKb9Transcript: https://drive.google.com/file/d/1TL9lnW_HOL_BuN_wRDrWZb7e-kWUZedr/view?usp=sharingBy ReproducibiliTea Podcast

Links from this Episode:- Paper on the limits of open data for music science: https://emusicology.org/article/view/7646- Feminist papers on open science: https://journals.sagepub.com/doi/pdf/10.1177/03616843211030926?casa_token=x6twMszrtQgAAAAA:7Wu2Z2V0X58Lo403dJPiLT3jL65YBErd4f6FE_bhcfnie_Sg4oqax9yaMF1R02WEsB4KKNvLu7b32xsandhttps://journals.sagepu…

Find Kohinoor here: https://www.kohinoordarda.com/Find all the stuff mentioned in this episode here:The talk by a former senior admin, Dr. Max Liboiron: https://www.youtube.com/watch?v=Rya5Gom5o20The book on the not-for-profit industrial complex: https://www.dukeupress.edu/the-revolution-will-not-be-fundedThe organization Sarah is a part of and men…

What is the point of having a T in your name without being able to use it for a tea pun? ConTeabutorship was right there.More information on CRediT here: https://credit.niso.org/And more info on ReproducibiliTea here: https://ReproducibiliTea.org/Questions? Answers? Comments? Feel free to drop them here: forms.gle/bRFcfiGQof43stoq6Transcript: https…

Today, Sarah, Will, Sam and Jan discuss what kind of community we would like to foster and how you can get involved.One of those ways, send us your questions and comments, in audio or text right here: https://forms.gle/bRFcfiGQof43stoq6Another way: Find us on Twitter as @ReproducibiliT or send uns an E-Mail via ReproducibiliTea.org.The latter is al…

Sarah and Sam take a meandering discussion through slow science and what "slow" actually means in this context. Along the way, they also discuss some recommendations to promote slow science made in "Fast Lane to Slow Science" and how often scholarly critique often runs ahead of this slower pace.Links and references:Frith, U. (2020). Fast lane to sl…

Sarah and Will went/logged on to this years SIPS respectively and talk about their conference experience. It was cool!More infos www.improvingpsych.org and you can find the conference program here: https://docs.google.com/document/d/1Rka3f0ZY9BBZVIlZoVINrpyaJYeitpq1yKXBLukeMng/editFor more information about us and how to start your own Reproducibil…

Today, Sophia, Sam and Jan discuss conferences for the better part of an hour only to realize they is even still more to say... So stay tuned to this becoming like a regular episode.Transcript will be added asap. Till then you can find subtitles in the youtube version of this episode:By ReproducibiliTea Podcast

Today @Will_Ngiam talks to @eneayegba_ and @priyasilverst about the Nowhere LabCheck out The Nowhere Lab at https://nowherelab.com/ or @theNowhereLabThis episode was produced by William Ngiam and edited by Jan Vornhagen.Learn more on ReproducibiliTea.orgThe Transcript will be added asap. Till then, you can find subtitles in the youtube version of t…

Our new co-hosts @Will_Ngiam, @Sarah_Sauve, and @VornhagenJB discuss how Science needs to be better while also sharing way to much cool ressources.Transcript: https://drive.google.com/file/d/1lD0tTr-E-vv4lH8cJ9ItXedinORxnnQE/view?usp=sharingRessources like the blogpost that caused this:https://williamngiam.github.io/Science_needs_to_be_better/Cool …

We are back! ReproducibiliTea 2.0 not titled #TheNewNormal.ReproducibiliTea is back with a new ambitions and rotating hosts, but first we hand the whole thing over.For hopefully not the last time brewed by @OrbenAmy, @Sam_D_Parsons and @CruwelliFind the Transcript here: https://drive.google.com/file/d/1bTwTL6S2Ov9nlfSKdUxxEdweSM9Uwhmh/view?usp=shar…

Episode 34 - Clarissa CarneiroEarly in May we talked to Clarissa (@clari_carneiro) from the Brazilian Reproducibility Initiative (@BrRepInitiative). This project is awesome - think many labs for Brazilian biomedical sciences, with a dash of meta in there too! Tune in to hear about this amazing project. Links:The project: https://www.reprodutibilida…

Episode 33 with Flavio Azevedo on FORRTOur latest awesome ECR you need to watch out for is Flavio Azevedo @Flavio_Azevedo_. He was recently named one of one of the top 100 global shapers from Portugal! (https://www.100oportunidades.pt/) and by gosh he's just one of our favorite people too.Flavio tells us all about the importance of openness in repr…

Episode 32 - Research under Crisis with Anne ScheelWe have a very special guest in this lockdown episode of ReproducibiliTea: Anne Scheel (@annemscheel). We reflect on research during the COVID-19 pandemic and the wide range of responses from the research community. We talked to Anne about her recent blogpost “Crisis research, fast and slow” (http:…

Episode 31: Class 2 - What even is a replication?It’s week 2 of Amy’s “Psychology as a Robust Science” course and we are discussing replications. What are they? Is there a distinction between direct and conceptual replications? Do direct replications actually exist? Tune in to (maybe) find out!Related papers and linksOpen Science Collaboration (201…

SolidariTEA 2 - Green Advocacy With Sander van BreeSolidariTEA is our mini series where we stand in solidarity against the worse side of academia, and stand in solidarity alongside the many awesome advocates for improving academia.This time Sophia talks with Sander van Bree (@sandervanbree) about green advocacy. What actions can you take to reduce …

Episode 30 – What are we doing? AKA the golden pancakeWe are starting a new 8 part series following the structure of Amy’s “Psychology as a Robust Science” course (https://www.amyorben.com/docs/syllabus.pdf). We will take a specific aspect from each week and dive into the detail. This week: Introductions and Merton’s norms, what is Science? We disc…

Episode 29 - Four Hero Origin Stories To Start 2020Welcome to 2020. We are back to our regular recording and releasing schedule. Sorry for the wait, and thank you for your patience.We begin with Sophia and Sam's starts to the year at the Advanced Methods for Reproducible Science workshop, aka #Repro20. All three of us have attended this workshop ov…

Episode 28 - Jade Pickering and Marta ToporThis time we are joined by the amazing Jade Pickering (@Jade_Pickering) and Marta Topor (@MartaTopor). Jade and Marta share their own ReproducibiliTea experiences and an exciting new project on building tools for systematic reviews. Watch this space as the duo get ready to release this tool to the wilds!Ke…

In the first of our new SolidariTea sub-series, Amy Orben talks to Robert Stenson from the University of Nottingham, UK, where he is finishing a PhD at the School of Cultures, Languages and Area Studies. SolidariTea episodes are short podcast conversations with Early Career Researchers around the world that highlight injustices, campaigns, struggle…

Episode 27 - More advice on starting a PhDWe return to thinking about starting a PhD. This is part 2 of our series. Sophia brought Amy and Sam some more questions and they had thoughts. If you have any thoughts, comments, and different perspectives we would love to hear them. Please reach out and tell us your thoughts and experiences. Question 4 - …

Episode 26 - Advice on starting a PhDIn a slight change of pace, Sophia interviews Amy and Sam for advice on starting a PhD. This is part 1 of a two part series on advice for new PhDs. If you have any thoughts or comments, hit up our twitter and join the conversation.Caveat: Amy and Sam both completed their PhDs in Experimental Psychology at Oxford…

Episode 25 - Starting A ReproducibiliTea Journal Club With Jade Pickering And Angelika StefanWhy did we start the ReproducibiliTea Journal club, and how can you start your own? Sam and Amy share their experiences before we listen in on a discussion with two very special guests. Jade Pickering (@Jade_Pickering) and Angelika Stefan (@ephemeralidea) d…

Episode 24 - ConferencesThis time we talk academic conferences! What do we thing about them as ECRs? Amy was at the ABCD workshop during recording (check out https://abcdstudy.org/) giving a hands-on picture of conference activities. Of course, we couldn't talk conferences without mentioning our favourite SIPS!(see https://improvingpsych.org/meetin…

Episode 23 - Nick FoxSophia and Amy have a great chat with Nick Fox (@NickFoxstats). Nick is a Research Scientist in the Center for Open Science.Nick tells us his winding story from being a psych-hating undergrad, through biochem and behavioural neuroscience, to social psychology and meta-science (the full story is on his blog https://nickfox.netli…

Episode 22 - PsychBriefThis time we chat to another awesome ECR, PsychBrief! You may have seen his very popular blog on psychologocal methods http://psychbrief.com/ or seen him dropping truth bombs on twitter @PsyBriefNo, we don't reveal PsychBriefs real identity, but he does let us in on why he started and maintains his anonymous profile and his e…

Episode 21 - Katia DamerThis episode we talked to the co-founder and CEO of Prolific Academic (https://prolific.ac/), Katia Damer. Prolific Academic is a platform connecting researchers with a pool of research participants for online data collection. We discuss Katia's experience of founding Prolific as a start-up during her PhD and how prolific br…

Episode 20 - Priya SilversteinBuckle up to hear Priya discuss running (and publishing) replication research and diversity in science. This was perhaps the most eventful recording session we have ever had, but we really enjoyed the conversation. The more diversity the better!Music credit: Be Jammin - Alexander Nakaradafreepd.com/world.php…

Episode 19 - Katie DraxIntroducing Katie Drax! an upcoming force in open and reproducible research! Katie is leading MAPS: Mapping the Analytical PathS of a crowdsourced data analysis. Katie also leads the Bristol branch of the ReproducibiliTea Journal Club - with much more success in cataloging the JC than we manage. Katie also has some great advi…

Episode 18 - Hannah HobsonMeet Dr. Hannah Hobson, a true Registered Reports pioneer! Hannah was one of the early adopters of the registered report format, and during her PhD no less. We had to speak to her and hear her unique perspective on this research publication format. Highlights and links:Hannah's Mu registered report (https://www.sciencedire…

Episode 17 - Lisa Spitzer And Tobias HeyckeThis week we have two special guests, two more awesome ECRs we want you to meet! Lisa Spitzer (@Lisa__Spitzer) and Tobias Heycke (@TobiasHeycke) discuss their project with us - using screen recordings of computerised experimental procedures to assist with reproducibility.Check out Lisa and Tobias' preprint…

Episode 16 - Leonid TiokhinIn another SpecialiTEA we had the pleasure of chatting to Leo Tiokhin @LeonidTiokhin about his path to meta science and his current work.We had a slight technical hiccup, but Sophia saved us with a back-up recording!To find out more about Leo's recent Registered Report "An experimental test of the effects of competition f…

Episode 15 - Responding To The Fallibility Of OthersIn this second part-er we revisit Dorothy Bishop's "Fallibility in Science: Responding to Errors in the Work of Oneself and Others". Last episode we discussed responding to one's own errors. We got so wrapped up that we didn't get onto responding to others errors. So, we're back;Highlights: How sh…

Episode 14 - Responding to fallibility in scienceThis week we discuss Professor Dorothy Bishop's "Responding to fallibility in science" https://journals.sagepub.com/doi/10.1177/2515245918776632Its been a while since we discussed a paper on the podcast. We really got into this discussion, and only got as far as "How should we deal with our own error…

Episode 13 – Fighting the impostor (syndrome) Hello 2019! Amy, Sophia, and Sam discuss impostor syndrome. While Sam was concerned this would leave him wanting to hide under the desk and cry-eat chocolate for the rest of the day, it turned into an unexpectedly uplifting talk. Get in touch with your experiences; what helps? what makes it worse? how c…

Last time we chatted to Ivan about his Thesis, but there was just too much to cover. Luckily, Ivan is a dude and agreed to chat to us again. Hope you enjoyIvan’s Dissertation “Discipline through method: Recent history and philosophy of scientific psychology (1950-2018)” https://www.dropbox.com/s/amjv3oyu8u09nw2/2018%20thesis%20Ivan%20Flis%20final%2…