Episode Notes
Episode Summary
- Introduction to Open Science – Asier Moneva introduces open science, emphasizing transparency and replicability as essential to modern research.
- Importance of Transparency – He explains how transparency builds trust, enabling other researchers to assess rigor and replicate findings accurately.
- Preregistration and Registered Reports – Asier discusses these practices, which require researchers to specify methodologies and hypotheses before data collection to reduce bias.
- Challenges in Adoption – He notes that implementing open science practices can be challenging due to academic pressures and resource limitations.
- The “Publish or Perish” Culture – We highlight how the pressure to publish quickly can conflict with the time-intensive requirements of open science.
- Academic Incentives and Misaligned Goals – We critique the academic reward system that often favors quantity over quality, which can detract from scientific rigor.
- Advantages for Public Accessibility – Open science also enhances public accessibility, making research available beyond academia and helping inform public policy.
- Ethical Considerations in Research – Asier emphasizes that open science fosters ethical research practices by reducing questionable practices like p-hacking and selective reporting.
- Benefits of Open Science for Collaboration – The approach encourages collaboration across disciplines and institutions, providing a more comprehensive understanding of complex issues.
- Real-World Example of Retraction – He mentions a case where a research paper was retracted due to lack of transparency, illustrating the importance of open science practices.
- Role of Preprints in Open Science – Asier advocates for preprints as a way to share research and receive feedback before formal publication.
- Challenges with Platform Fragmentation – He observes that the proliferation of research-sharing platforms can hinder accessibility if findings are scattered across multiple sources.
- Future of Registered Reports – Asier sees registered reports as a future standard, as they align research design with ethical and rigorous science.
- Open Science as a Solution to Publication Bias – Open science practices help address publication bias by promoting the dissemination of all research findings, regardless of outcomes.
- Closing Thoughts on Transparency – Open science is about ensuring reproducibility and holding science accountable, aiming to make research as transparent and accessible as possible.
About Our Guest:
Asier Moneva
https://asiermoneva.com
https://nscr.nl/en/medewerker/asier-moneva/
https://www.thuas.com/research/research-groups/team-cybercrime-cybersecurity
https://github.com/amoneva
https://osf.io/7ce24/
Resources and References Mentioned in This Episode:
The Open Science Framework (OSF)
The OSF is an open-source platform supporting transparent and reproducible research across disciplines.
The Open Science Framework:
https://osf.io/
Paper Introducing Registered Reports
This foundational paper outlines the concept of registered reports, a publishing model aimed at reducing bias and enhancing research rigor.
Paper introducing "registered reports":
https://psycnet.apa.org/fulltext/2014-20922-001.html
Retraction Case Study
A recent retraction of a notable article on the replicability of social-behavioral research findings offers insights into challenges within open science practices.
RETRACTED ARTICLE: High replicability of newly discovered social-behavioural findings is achievable:
https://www.nature.com/articles/s41562-023-01749-9
Retraction Note: High replicability of newly discovered social-behavioural findings is achievable:
https://www.nature.com/articles/s41562-024-01997-3
Podcast episode discussing the retraction in depth:
https://open.spotify.com/episode/3rygrbUNocfCEEGd1Byn0V?si=vJDuzQT3S7yJqDEUMycF1w&t=178
Other:
This episode was recorded in a hotel lobby corner with music playing in the background. If the audio sounds a little unusual at times it is because of the noise removal being used to remove that noise being combined with other ‘sound enhancement’ features. I had to go back in and play around with the audio directly before I was even a little happy. The tools work well but they are a little unpredictable. I am increasingly wary of ‘it just works’ audio editing tools. I would have left it in, but the bots chasing copyright infringement are ravenous and indiscriminate.
