Look for any podcast host, guest or anyone
Showing episodes and shows of

Daniel Lakens

Shows

Nullius in Verba
Nullius in VerbaEpisode 62: Experimenta ExploratoriaIn this episode we discuss exploratory experimentation, an iterative process used by scientists to better understand phenomena. We ask why exploratory research seems to be valued less in science, the importance of lab notebooks, and what makes for a good exploratory study.   References: Steinle, F. (2016). Exploratory experiments: Ampère, Faraday, and the origins of electrodynamics. University of Pittsburgh press. Skinner, B. F. (1956). A case history in scientific method. American Psychologist, 11(5), 221–233. Popper, K. R. (1962). Conjectures and refutations: The growth of scientific knowledge. Routledge. Ditroilo, M., Mesquida ,Cristian, Abt...
2025-07-041h 08Nullius in Verba
Nullius in VerbaEpisode 62: Experimenta ExploratoriaIn this episode we discuss exploratory experimentation, an iterative process used by scientists to better understand phenomena. We ask why exploratory research seems to be valued less in science, the importance of lab notebooks, and what makes for a good exploratory study.   References: Steinle, F. (2016). Exploratory experiments: Ampère, Faraday, and the origins of electrodynamics. University of Pittsburgh press. Skinner, B. F. (1956). A case history in scientific method. American Psychologist, 11(5), 221–233. Popper, K. R. (1962). Conjectures and refutations: The growth of scientific knowledge. Routledge. Ditroilo, M., Mesquida ,Cristian, Abt...
2025-07-041h 08Nullius in Verba
Nullius in VerbaEpisode 53: Fraus - IIBroad, W. J., & Wade, N. (1983). Betrayers of the truth. New York : Simon and Schuster. http://archive.org/details/betrayersoftruth00broa Wolfgang Stroebe, Tom Postmes, & Russell Spears. (2012). Scientific Misconduct and the Myth of Self-Correction in Science. Perspectives on Psychological Science, 7(6), 670–688. https://doi.org/10.1177/1745691612460687   Zotero can track if you are citing retractions: https://retractionwatch.com/2019/06/12/want-to-check-for-retractions-in-your-personal-library-and-get-alerts-for-free-now-you-can/   100% CI blog: The Untold Mystery of Rogue RA https://www.the100.ci/2024/12/18/rogue-ra/   Merton, R. K. (1957). Priorities in Scientific Discovery: A Chapter in the Sociology of Science. American Sociological Review, 22(6), 635–659. https://doi.org/1...
2025-02-2151 minNullius in Verba
Nullius in VerbaEpisode 53: Fraus - IIBroad, W. J., & Wade, N. (1983). Betrayers of the truth. New York : Simon and Schuster. http://archive.org/details/betrayersoftruth00broa Wolfgang Stroebe, Tom Postmes, & Russell Spears. (2012). Scientific Misconduct and the Myth of Self-Correction in Science. Perspectives on Psychological Science, 7(6), 670–688. https://doi.org/10.1177/1745691612460687   Zotero can track if you are citing retractions: https://retractionwatch.com/2019/06/12/want-to-check-for-retractions-in-your-personal-library-and-get-alerts-for-free-now-you-can/   100% CI blog: The Untold Mystery of Rogue RA https://www.the100.ci/2024/12/18/rogue-ra/   Merton, R. K. (1957). Priorities in Scientific Discovery: A Chapter in the Sociology of Science. American Sociological Review, 22(6), 635–659. https://doi.org/1...
2025-02-2151 minRSam Podcast
RSam PodcastDaniel Lakens: Metascience, Open Science and a Philosophy of StatisticsProf Daniel Lakens is an Associate Professor in the Human-Technology interaction group at Eindhoven University of Technology. His areas of expertise include meta-science, research methods and applied statistics. Prof Lakens' main lines of empirical research focus on conceptual thought, similarity, and meaning. He also focuses on how to design and interpret studies, applied (meta)-statistics, and reward structures in science. Outside academia, Prof Lakens has a podcast on science called Nullius in Verba with his cohost, Smriti Mehta, from UC Berkeley. In this episode, we discuss metascience, the openness initiative in science, incentive structures, scientific realism vs anti-realism, and...
2024-09-131h 38Nullius in Verba
Nullius in VerbaEpisode 42: Aestimatio ScriptorumIn today’s episode, we discuss critically reading and appraising scientific articles. How do we select which articles to read carefully? Which heuristics are useful for assessing paper quality? And do open science practices actually lead to better quality papers? Enjoy.    Shownotes Bacon, F. (1625). Of Studies.  PNAS Submissions contributed by NAS members "The contributing member submits the manuscript to PNAS along with the names of at least two experts in the field of the paper who have agreed to review the work and brief comments about why each of those reviewers was chosen."  https://www.pn...
2024-09-061h 05Nullius in Verba
Nullius in VerbaEpisode 42: Aestimatio ScriptorumIn today’s episode, we discuss critically reading and appraising scientific articles. How do we select which articles to read carefully? Which heuristics are useful for assessing paper quality? And do open science practices actually lead to better quality papers? Enjoy.    Shownotes Bacon, F. (1625). Of Studies.  PNAS Submissions contributed by NAS members "The contributing member submits the manuscript to PNAS along with the names of at least two experts in the field of the paper who have agreed to review the work and brief comments about why each of those reviewers was chosen."  https://www.pn...
2024-09-061h 05Clearer Thinking with Spencer Greenberg
Clearer Thinking with Spencer GreenbergShould we trust papers published in top social science journals? (with Daniel Lakens) Read the full transcript here. How much should we trust social science papers in top journals? How do we know a paper is trustworthy? Do large datasets mitigate p-hacking? Why doesn't psychology as a field seem to be working towards a grand unified theory? Why aren't more psychological theories written in math? Or are other scientific fields mathematicized to a fault? How do we make psychology cumulative? How can we create environments, especially in academia, that incentivize constructive criticism? Why isn't peer review pulling its weight in terms of catching errors and constructively criticizing papers? What kinds...
2024-07-251h 41Nullius in Verba
Nullius in VerbaEpisode 38 - Replicatio - IIIn this episode, we continue our discussion of replications. We talk about how to analyze replication studies, which studies are worth replicating, and what is the status of replications in other scientific disciplines.    Shownotes Mack, R. W. (1951). The Need for Replication Research in Sociology. American Sociological Review, 16(1), 93–94. https://doi.org/10.2307/2087978 Smith, N. C. (1970). Replication studies: A neglected aspect of psychological research. American Psychologist, 25(10), 970–975. https://doi.org/10.1037/h0029774 Sidman, M. (1960). Tactics of Scientific Research: Evaluating Experimental Data in Psychology (New edition). Cambridge Center for Behavioral. Ebersole, C. R., Mathur, M. B., Baranski, E., Bart-Plange, D.-J., B...
2024-07-1254 minNullius in Verba
Nullius in VerbaEpisode 38 - Replicatio - IIIn this episode, we continue our discussion of replications. We talk about how to analyze replication studies, which studies are worth replicating, and what is the status of replications in other scientific disciplines.    Shownotes Mack, R. W. (1951). The Need for Replication Research in Sociology. American Sociological Review, 16(1), 93–94. https://doi.org/10.2307/2087978 Smith, N. C. (1970). Replication studies: A neglected aspect of psychological research. American Psychologist, 25(10), 970–975. https://doi.org/10.1037/h0029774 Sidman, M. (1960). Tactics of Scientific Research: Evaluating Experimental Data in Psychology (New edition). Cambridge Center for Behavioral. Ebersole, C. R., Mathur, M. B., Baranski, E., Bart-Plange, D.-J., B...
2024-07-1254 minNullius in Verba
Nullius in VerbaEpisode 37: Replicatio - IIn the next two episodes, we will discuss replication studies, which are essential to building reliable scientific knowledge.   Shownotes Mack, R. W. (1951). The Need for Replication Research in Sociology. American Sociological Review, 16(1), 93–94. https://doi.org/10.2307/2087978 Smith, N. C. (1970). Replication studies: A neglected aspect of psychological research. American Psychologist, 25(10), 970–975. https://doi.org/10.1037/h0029774 Sidman, M. (1960). Tactics of Scientific Research: Evaluating Experimental Data in Psychology (New edition). Cambridge Center for Behavioral. Ebersole, C. R., Mathur, M. B., Baranski, E., Bart-Plange, D.-J., Buttrick, N. R., Chartier, C. R., Corker, K. S., Corley, M., Hartshorne, J. K., IJzer...
2024-06-2855 minNullius in Verba
Nullius in VerbaEpisode 37: Replicatio - IIn the next two episodes, we will discuss replication studies, which are essential to building reliable scientific knowledge.   Shownotes Mack, R. W. (1951). The Need for Replication Research in Sociology. American Sociological Review, 16(1), 93–94. https://doi.org/10.2307/2087978 Smith, N. C. (1970). Replication studies: A neglected aspect of psychological research. American Psychologist, 25(10), 970–975. https://doi.org/10.1037/h0029774 Sidman, M. (1960). Tactics of Scientific Research: Evaluating Experimental Data in Psychology (New edition). Cambridge Center for Behavioral. Ebersole, C. R., Mathur, M. B., Baranski, E., Bart-Plange, D.-J., Buttrick, N. R., Chartier, C. R., Corker, K. S., Corley, M., Hartshorne, J. K., IJzer...
2024-06-2855 minNullius in Verba
Nullius in VerbaEpisode 35: Praedictio Clinica Versus StatisticaIn this final episode of the three-part series on the Philosophical Psychology lectures by Paul Meehl, we discuss lectures 6-8, which cover the ten obfuscating factors in "soft areas" of psychology and a host of advice Meehl provides for researchers, reviewers, editors, and educators on how to improve practice.    Shownotes Krefeld-Schwalb, A., Sugerman, E. R., & Johnson, E. J. (2024). Exposing omitted moderators: Explaining why effect sizes differ in the social sciences. Proceedings of the National Academy of Sciences, 121(12), e2306281121. https://doi.org/10.1073/pnas.2306281121 Lakens, D., & Etz, A. J. (2017). Too True to be Bad: When Sets of...
2024-05-311h 08Nullius in Verba
Nullius in VerbaEpisode 35: Praedictio Clinica Versus StatisticaIn this final episode of the three-part series on the Philosophical Psychology lectures by Paul Meehl, we discuss lectures 6-8, which cover the ten obfuscating factors in "soft areas" of psychology and a host of advice Meehl provides for researchers, reviewers, editors, and educators on how to improve practice.    Shownotes Krefeld-Schwalb, A., Sugerman, E. R., & Johnson, E. J. (2024). Exposing omitted moderators: Explaining why effect sizes differ in the social sciences. Proceedings of the National Academy of Sciences, 121(12), e2306281121. https://doi.org/10.1073/pnas.2306281121 Lakens, D., & Etz, A. J. (2017). Too True to be Bad: When Sets of...
2024-05-311h 08Nullius in Verba
Nullius in VerbaEpisode 31: CriticismusIn this episode, we discuss the role of criticism in science. When is criticism constructive as opposed to obsessive? What are the features of fair and useful scientific criticism? And should we explicitly teach junior researchers to both give and accept criticism?   Shownotes: Babbage, C. (1830). Reflections on the Decline of Science in England: And on Some of Its Causes. Prasad, Vinay, and John PA Ioannidis. "Constructive and obsessive criticism in science." European journal of clinical investigation 52.11 (2022): e13839. Lakatos, I. (1968, January). Criticism and the methodology of scientific research programmes. In Proceedings of the Aristotelian society (V...
2024-04-051h 15Nullius in Verba
Nullius in VerbaEpisode 31: CriticismusIn this episode, we discuss the role of criticism in science. When is criticism constructive as opposed to obsessive? What are the features of fair and useful scientific criticism? And should we explicitly teach junior researchers to both give and accept criticism?   Shownotes: Babbage, C. (1830). Reflections on the Decline of Science in England: And on Some of Its Causes. Prasad, Vinay, and John PA Ioannidis. "Constructive and obsessive criticism in science." European journal of clinical investigation 52.11 (2022): e13839. Lakatos, I. (1968, January). Criticism and the methodology of scientific research programmes. In Proceedings of the Aristotelian society (V...
2024-04-051h 15Nullius in Verba
Nullius in VerbaEpisode 27: Vocans Ictus Tuos - Pars IIIn today’s episode, we continue our conversation about preregistration. How flexible can we be when we preregister, without increasing flexibility in our analysis? How well do people preregister, and what does a good preregistration look like? And how do we deal with deviations from preregistrations?   Shownotes   Dubin, R. (1969). Theory building. Free Press. His full quote is: "There is no more devastating commendation that the self-designated theorist makes of the researcher than to label his work purely descriptive".  Claesen, A., Gomes, S., Tuerlinckx, F., & Vanpaemel, W. (2021). Comparing dream to reality: An assessment of ad...
2024-02-0959 minNullius in Verba
Nullius in VerbaEpisode 27: Vocans Ictus Tuos - Pars IIIn today’s episode, we continue our conversation about preregistration. How flexible can we be when we preregister, without increasing flexibility in our analysis? How well do people preregister, and what does a good preregistration look like? And how do we deal with deviations from preregistrations?   Shownotes   Dubin, R. (1969). Theory building. Free Press. His full quote is: "There is no more devastating commendation that the self-designated theorist makes of the researcher than to label his work purely descriptive".  Claesen, A., Gomes, S., Tuerlinckx, F., & Vanpaemel, W. (2021). Comparing dream to reality: An assessment of ad...
2024-02-0959 minNullius in Verba
Nullius in VerbaEpisode 26: Vocans Ictus Tuos - Pars IIn this two part episode we discuss the fine art of preregistration. We go back into the history of preregistration, its evolution, and current use. Do we preregister to control the Type 1 error rate, or to show that we derived our prediction from theory a priori? Can and should we preregister exploratory or secondary data analysis? And how severe is the issue of severe testing?   Shownotes ClinicalTrials.gov You can preregister on AsPredicted and the OSF Johnson, M. (1975). Models of Control and Control of Bias. European Journal of Parapsychology, 36–44. SPIRIT Checklist Bishop, D. V. M...
2024-01-261h 01Nullius in Verba
Nullius in VerbaEpisode 26: Vocans Ictus Tuos - Pars IIn this two part episode we discuss the fine art of preregistration. We go back into the history of preregistration, its evolution, and current use. Do we preregister to control the Type 1 error rate, or to show that we derived our prediction from theory a priori? Can and should we preregister exploratory or secondary data analysis? And how severe is the issue of severe testing?   Shownotes ClinicalTrials.gov You can preregister on AsPredicted and the OSF Johnson, M. (1975). Models of Control and Control of Bias. European Journal of Parapsychology, 36–44. SPIRIT Checklist Bishop, D. V. M...
2024-01-261h 01Nullius in Verba
Nullius in VerbaEpisode 23: Contra Creativitatem Epistolae - Pars IIn the first of a two-part episode, we discuss The Anticreativity Letters by Richard Nisbett, in which a senior "tempter" advises a junior tempter on ways to prevent a young psychologist from being a productive and creative scientist. Nisbett, R. E. (1990). The anticreativity letters: Advice from a senior tempter to a junior tempter. American Psychologist, 45(9), 1078–1082. BMJ Christmas issue: https://www.bmj.com/about-bmj/resources-authors/article-types/christmas-issue Quote by Ira Glass: https://www.goodreads.com/quotes/309485-nobody-tells-this-to-people-who-are-beginners-i-wish
2023-12-1548 minNullius in Verba
Nullius in VerbaEpisode 23: Contra Creativitatem Epistolae - Pars IIn the first of a two-part episode, we discuss The Anticreativity Letters by Richard Nisbett, in which a senior "tempter" advises a junior tempter on ways to prevent a young psychologist from being a productive and creative scientist. Nisbett, R. E. (1990). The anticreativity letters: Advice from a senior tempter to a junior tempter. American Psychologist, 45(9), 1078–1082. BMJ Christmas issue: https://www.bmj.com/about-bmj/resources-authors/article-types/christmas-issue Quote by Ira Glass: https://www.goodreads.com/quotes/309485-nobody-tells-this-to-people-who-are-beginners-i-wish
2023-12-1548 minNullius in Verba
Nullius in VerbaPrologus 23: The Anticreativity Letters (R. E. Nisbett)A reading of: Nisbett, R. E. (1990). The anticreativity letters: Advice from a senior tempter to a junior tempter. American Psychologist, 45(9), 1078–1082. https://doi.org/10.1037/0003-066X.45.9.1078
2023-12-0835 minNullius in Verba
Nullius in VerbaPrologus 23: The Anticreativity Letters (R. E. Nisbett)A reading of: Nisbett, R. E. (1990). The anticreativity letters: Advice from a senior tempter to a junior tempter. American Psychologist, 45(9), 1078–1082. https://doi.org/10.1037/0003-066X.45.9.1078
2023-12-0835 minNullius in Verba
Nullius in VerbaEpisode 22: MagisteriumIn today’s episode, we discuss the role of mentorship in academia. What are the characteristics of a good mentor-mentee relationship? What are the qualities of good mentors and good mentees? Does mentorship play a role in the development of scientific knowledge? And could mentors and mentees benefit from couples therapy? Note: D.I.H.C is pronounced 'dick' but this is meant to be a family-friendly podcast :)   Shownotes https://www.psychologytoday.com/us/blog/emotional-fitness/201303/10-things-your-relationship-needs-thrive Roberts, L. R., Tinari, C. M., & Bandlow, R. (2019). An effective doctoral student mentor wears many hat...
2023-12-0157 minNullius in Verba
Nullius in VerbaEpisode 22: MagisteriumIn today’s episode, we discuss the role of mentorship in academia. What are the characteristics of a good mentor-mentee relationship? What are the qualities of good mentors and good mentees? Does mentorship play a role in the development of scientific knowledge? And could mentors and mentees benefit from couples therapy? Note: D.I.H.C is pronounced 'dick' but this is meant to be a family-friendly podcast :)   Shownotes https://www.psychologytoday.com/us/blog/emotional-fitness/201303/10-things-your-relationship-needs-thrive Roberts, L. R., Tinari, C. M., & Bandlow, R. (2019). An effective doctoral student mentor wears many hat...
2023-12-0157 minDecoding the Gurus
Decoding the GurusInterview with Daniël Lakens and Smriti Mehta on the state of PsychologyWe are back with more geeky academic discussion than you can shake a stick at. This week we are doing our bit to save civilization by discussing issues in contemporary science, the replication crisis, and open science reforms with fellow psychologists/meta-scientists/podcasters, Daniël Lakens and Smriti Mehta. Both Daniël and Smriti are well known for their advocacy for methodological reform and have been hosting a (relatively) new podcast, Nullius in Verba, all about 'science—what it is and what it could be'. We discuss a range of topics including questionable research practices, the implications of t...
2023-11-182h 42Nullius in Verba
Nullius in VerbaEpisode 21: Verifica Sed ConfideIn this episode, we discuss the role of trust in science. Why should we verify but trust other scientists? What are the prerequisites for building trust within the scientific community? Who is ultimately responsible for verifying our claims and practices that bolster those claims? And should we give personality tests to everyone who enters academia?   Shownotes Hardwig, J. (1991). The role of trust in knowledge. The Journal of Philosophy, 88(12), 693–708. Hendriks, F., Kienhues, D., Bromme, R. (2016). Trust in Science and the Science of Trust. In: Blöbaum, B. (eds) Trust and Communication in a Digitized World. Prog...
2023-11-1755 minNullius in Verba
Nullius in VerbaEpisode 21: Verifica Sed ConfideIn this episode, we discuss the role of trust in science. Why should we verify but trust other scientists? What are the prerequisites for building trust within the scientific community? Who is ultimately responsible for verifying our claims and practices that bolster those claims? And should we give personality tests to everyone who enters academia?   Shownotes Hardwig, J. (1991). The role of trust in knowledge. The Journal of Philosophy, 88(12), 693–708. Hendriks, F., Kienhues, D., Bromme, R. (2016). Trust in Science and the Science of Trust. In: Blöbaum, B. (eds) Trust and Communication in a Digitized World. Prog...
2023-11-1755 minNullius in Verba
Nullius in VerbaPrologus 21: Role of Trust in Knowledge (J. Hardwig)In advance of our episode Verify but Trust, a reading of John Hardwig's paper The Role of Trust in Science.  Hardwig, J. (1991). The role of trust in knowledge. The Journal of Philosophy, 88(12), 693–708.
2023-11-1046 minNullius in Verba
Nullius in VerbaPrologus 21: Role of Trust in Knowledge (J. Hardwig)In advance of our episode Verify but Trust, a reading of John Hardwig's paper The Role of Trust in Science.  Hardwig, J. (1991). The role of trust in knowledge. The Journal of Philosophy, 88(12), 693–708.
2023-11-1046 minNullius in Verba
Nullius in VerbaEpisode 20: Recensio AequaliumIn today’s episode, we discuss the peer review process---its history, its present, and its future. How does peer review work? How long has it existed in its current form? Should reviews be open and signed? Should reviewers be paid for their hard labor? Should we just abandon the peer review process, or does it have a positive role to play?    Shownotes Peer Community in Registered Reports: https://rr.peercommunityin.org/ Suggestion to Darwin to publish a book about pigeons instead of The Origins of Species: https://www.darwinproject.ac.uk/letter/DCP-LETT-2457A.xml ...
2023-11-031h 12Nullius in Verba
Nullius in VerbaEpisode 20: Recensio AequaliumIn today’s episode, we discuss the peer review process---its history, its present, and its future. How does peer review work? How long has it existed in its current form? Should reviews be open and signed? Should reviewers be paid for their hard labor? Should we just abandon the peer review process, or does it have a positive role to play?    Shownotes Peer Community in Registered Reports: https://rr.peercommunityin.org/ Suggestion to Darwin to publish a book about pigeons instead of The Origins of Species: https://www.darwinproject.ac.uk/letter/DCP-LETT-2457A.xml ...
2023-11-031h 12Nullius in Verba
Nullius in VerbaEpisode 19: QuantifauxcationIn this episode, we discuss Quantifauxcation, described by statistician Philip Stark as “situations in which a number is, in effect, made up, and then is given credence merely because it is quantitative.” We give examples of quantifauxcation in psychology, including errors of the third kind. We spend the second half of the podcast discussing how to develop quantitative measures that are meaningful and bridge the divide between qualitative and quantitative observations.   Shownotes Statistics textbook by Philip Stark. Stark, P. B. (2022). Pay No attention to the model behind the curtain. Pure and Applied Geophysics, 179(11), 4121–4145. https://doi.org...
2023-10-201h 18Nullius in Verba
Nullius in VerbaEpisode 19: QuantifauxcationIn this episode, we discuss Quantifauxcation, described by statistician Philip Stark as “situations in which a number is, in effect, made up, and then is given credence merely because it is quantitative.” We give examples of quantifauxcation in psychology, including errors of the third kind. We spend the second half of the podcast discussing how to develop quantitative measures that are meaningful and bridge the divide between qualitative and quantitative observations.   Shownotes Statistics textbook by Philip Stark. Stark, P. B. (2022). Pay No attention to the model behind the curtain. Pure and Applied Geophysics, 179(11), 4121–4145. https://doi.org...
2023-10-201h 18Nullius in Verba
Nullius in VerbaPrologus 19: Problem-Centering vs. Mean-Centering in Science (A. H. Maslow)In preparation for a discussion on Quantifauxcation, a reading of 'Problem-Centering vs. Means-Centering in Science' by Abraham H. Maslow (1946).  Maslow, A. H. (1946). Problem-Centering vs. Means-Centering in Science. Philosophy of Science, 13(4), 326–331. https://doi.org/10.1086/286907
2023-10-1325 minNullius in Verba
Nullius in VerbaPrologus 19: Problem-Centering vs. Mean-Centering in Science (A. H. Maslow)In preparation for a discussion on Quantifauxcation, a reading of 'Problem-Centering vs. Means-Centering in Science' by Abraham H. Maslow (1946).  Maslow, A. H. (1946). Problem-Centering vs. Means-Centering in Science. Philosophy of Science, 13(4), 326–331. https://doi.org/10.1086/286907
2023-10-1325 minNullius in Verba
Nullius in VerbaEpisode 18: Vitia VocationalisIn today’s episode, we discuss intellectual vices. How can we tell the difference between justified confidence and unjustified arrogance? How do we deal with feelings of envy or negative comparison with other scientists? What is the difference between building one’s career and careerism? And what do we do about scientists who do not care about the truth?    Shownotes Azrin, N. H., Holz, W., Ulrich, R., & Goldiamond, I. (1961). The control of the content of conversation through reinforcement. Journal of the Experimental Analysis of Behavior, 4, 25–30. https://doi.org/10.1901/jeab.1961.4-25  Meehl, P. E. (1967). Theory-testing in psycho...
2023-10-061h 15Nullius in Verba
Nullius in VerbaEpisode 18: Vitia VocationalisIn today’s episode, we discuss intellectual vices. How can we tell the difference between justified confidence and unjustified arrogance? How do we deal with feelings of envy or negative comparison with other scientists? What is the difference between building one’s career and careerism? And what do we do about scientists who do not care about the truth?    Shownotes Azrin, N. H., Holz, W., Ulrich, R., & Goldiamond, I. (1961). The control of the content of conversation through reinforcement. Journal of the Experimental Analysis of Behavior, 4, 25–30. https://doi.org/10.1901/jeab.1961.4-25  Meehl, P. E. (1967). Theory-testing in psycho...
2023-10-061h 15Nullius in Verba
Nullius in VerbaEpisode 17: SnobismusIn this episode, we discuss scientific snobbery and the ways in which it affects our interactions with and perceptions of other scientists. What are the reasons for hierarchies among different disciplines, institutions, and approaches to science? What are some ways in which snobbery manifests in science? And is it snobby to not want to present scientific posters? Enjoy.    Shownotes:  Ego and Math (3Blue1Brown) M. V. Berry; Regular and irregular motion. AIP Conf. Proc. 15 September 1978; 46 (1): 16–120. https://doi.org/10.1063/1.31417  
2023-09-221h 19Nullius in Verba
Nullius in VerbaEpisode 17: SnobismusIn this episode, we discuss scientific snobbery and the ways in which it affects our interactions with and perceptions of other scientists. What are the reasons for hierarchies among different disciplines, institutions, and approaches to science? What are some ways in which snobbery manifests in science? And is it snobby to not want to present scientific posters? Enjoy.    Shownotes:  Ego and Math (3Blue1Brown) M. V. Berry; Regular and irregular motion. AIP Conf. Proc. 15 September 1978; 46 (1): 16–120. https://doi.org/10.1063/1.31417  
2023-09-221h 19Nullius in Verba
Nullius in VerbaEpisode 16: Vetus Crisi ReplicatioIn this episode, we continue our conversation on the replication crisis⏤Which methodological, theoretical, and practical concerns did psychologists raise half a century ago? What has changed, and what remains the same, during the current crisis?    Shownotes Orne, M. T. (1962). On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist, 17(11), 776–783. https://doi.org/10.1037/h0043424 Rosenthal, R. (1966). Experimenter effects in behavioral research. Appleton-Century-Crofts. Gergen, K. J. (1973). Social psychology as history. Journal of Personality and Social Psychology, 26, 309–320. https://doi.org/10.1037/h0034436 Koole, S. L., & Lakens, D. (2012). Rewarding replicat...
2023-09-0842 minNullius in Verba
Nullius in VerbaEpisode 16: Vetus Crisi ReplicatioIn this episode, we continue our conversation on the replication crisis⏤Which methodological, theoretical, and practical concerns did psychologists raise half a century ago? What has changed, and what remains the same, during the current crisis?    Shownotes Orne, M. T. (1962). On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist, 17(11), 776–783. https://doi.org/10.1037/h0043424 Rosenthal, R. (1966). Experimenter effects in behavioral research. Appleton-Century-Crofts. Gergen, K. J. (1973). Social psychology as history. Journal of Personality and Social Psychology, 26, 309–320. https://doi.org/10.1037/h0034436 Koole, S. L., & Lakens, D. (2012). Rewarding replicat...
2023-09-0842 minNullius in Verba
Nullius in VerbaPrologus 16: Investigator Data Analysis Effect (T. X. Barber)Reading of the chapter "Investigator Data Analysis Effect" from the book: Barber, T. X. (1976). Pitfalls in Human Research: Ten Pivotal Points. Pergamon Press.
2023-09-0150 minNullius in Verba
Nullius in VerbaPrologus 16: Investigator Data Analysis Effect (T. X. Barber)Reading of the chapter "Investigator Data Analysis Effect" from the book: Barber, T. X. (1976). Pitfalls in Human Research: Ten Pivotal Points. Pergamon Press.
2023-09-0150 minNullius in Verba
Nullius in VerbaEpisode 15: Novum Crisi ReplicatiIn this episode, we discuss the replication crisis in psychology which has been an important topic of discussion for the last decade. We revisit some key events from the start of the replication crisis, such as the publication of Daryl Bem's studies on precognition, the paper False Positive Psychology, and the Reproducibility Project and share personal anecdotes about how it was to live through the replication crisis.   Shownotes:  Bem, D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100(3), 407–425. https://doi.org/10.1037/a0021524 Ritc...
2023-08-2555 minNullius in Verba
Nullius in VerbaEpisode 15: Novum Crisi ReplicatiIn this episode, we discuss the replication crisis in psychology which has been an important topic of discussion for the last decade. We revisit some key events from the start of the replication crisis, such as the publication of Daryl Bem's studies on precognition, the paper False Positive Psychology, and the Reproducibility Project and share personal anecdotes about how it was to live through the replication crisis.   Shownotes:  Bem, D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100(3), 407–425. https://doi.org/10.1037/a0021524 Ritc...
2023-08-2555 minNullius in Verba
Nullius in VerbaEpisode 14: Capax MentisIn this episode we reflect on the role of intelligence in scientist. How much does intelligence matter in science, and which other characteristics might play a role in doing good science? Do scientist need to be extremely intelligent or can anyone do science? And what is the role of stupidity in science?  Capax Mentis roughly translates to "capacity of mind." Smriti stupidly messed up her audio so the quality isn't great. Apologies!    Shownotes Schwartz, M. A. (2008). The importance of stupidity in scientific research. Journal of Cell Science, 121(11), 1771. https://doi.org/10.1242/jcs...
2023-08-131h 04Nullius in Verba
Nullius in VerbaEpisode 14: Capax MentisIn this episode we reflect on the role of intelligence in scientist. How much does intelligence matter in science, and which other characteristics might play a role in doing good science? Do scientist need to be extremely intelligent or can anyone do science? And what is the role of stupidity in science?  Capax Mentis roughly translates to "capacity of mind." Smriti stupidly messed up her audio so the quality isn't great. Apologies!    Shownotes Schwartz, M. A. (2008). The importance of stupidity in scientific research. Journal of Cell Science, 121(11), 1771. https://doi.org/10.1242/jcs...
2023-08-131h 04Nullius in Verba
Nullius in VerbaPrologus 14: How can I tell if I am cut out to be a scientific research worker? (P. B. Medawar)As prologue to the next episode on how smart one needs to be to be a scientist, we present a reading of chapter 2 "How can I tell if I am cut out to be a scientific research worker?" by Peter B. Medawar from his 1979 book 'Advice to a young scientist'. Our next episode was inspired by the section "Am I brainy enough to be a scientist?" https://www.google.nl/books/edition/Advice_To_A_Young_Scientist/3fg3DgAAQBAJ
2023-08-0415 minNullius in Verba
Nullius in VerbaPrologus 14: How can I tell if I am cut out to be a scientific research worker? (P. B. Medawar)As prologue to the next episode on how smart one needs to be to be a scientist, we present a reading of chapter 2 "How can I tell if I am cut out to be a scientific research worker?" by Peter B. Medawar from his 1979 book 'Advice to a young scientist'. Our next episode was inspired by the section "Am I brainy enough to be a scientist?" https://www.google.nl/books/edition/Advice_To_A_Young_Scientist/3fg3DgAAQBAJ
2023-08-0415 minNullius in Verba
Nullius in VerbaEpisode 13: ChmessIn this episode we discuss Daniel Dennett's distinction between chess, or research worth doing, and 'chmess,'  research not worth doing. We discuss ways to determine whether our research is chess or chmess, and how to avoid being sucked into lines of research we don't particularly care about.    Shownotes Dennett, D. C. (2006). Higher-order truths about chmess. Topoi, 25, 39–41. Dunnette, M. D. (1966). Fads, fashions, and folderol in psychology. American Psychologist, 21(4), 343. Folderol means 'a useless ornament or accessory', and is used to indicate something is 'nonsense'.  Dweck, C. S. (2022). Mindsets: From bathtubs to hot beliefs to social change...
2023-07-281h 04Nullius in Verba
Nullius in VerbaEpisode 13: ChmessIn this episode we discuss Daniel Dennett's distinction between chess, or research worth doing, and 'chmess,'  research not worth doing. We discuss ways to determine whether our research is chess or chmess, and how to avoid being sucked into lines of research we don't particularly care about.    Shownotes Dennett, D. C. (2006). Higher-order truths about chmess. Topoi, 25, 39–41. Dunnette, M. D. (1966). Fads, fashions, and folderol in psychology. American Psychologist, 21(4), 343. Folderol means 'a useless ornament or accessory', and is used to indicate something is 'nonsense'.  Dweck, C. S. (2022). Mindsets: From bathtubs to hot beliefs to social change...
2023-07-281h 04Nullius in Verba
Nullius in VerbaPrologus 13: Chmess (D. C. Dennett)As prologue to the next episode on Chmess, we present a reading of a paper by Daniel C. Dennett:  Dennett, D. C. (2006). Higher-order truths about chmess. Topoi, 25, 39–41.
2023-07-2813 minNullius in Verba
Nullius in VerbaPrologus 13: Chmess (D. C. Dennett)As prologue to the next episode on Chmess, we present a reading of a paper by Daniel C. Dennett:  Dennett, D. C. (2006). Higher-order truths about chmess. Topoi, 25, 39–41.
2023-07-2813 minNullius in Verba
Nullius in VerbaEpisode 12: Virtutes VocationalisIn today's episode, we discuss vocational virtues⸺scientific principles that should guide the behavior of scientists. We discuss whether we agree with values put forth by numerous scientists, including Ivan Pavlov, Peter Medawar, Santiago Ramón y Cajal, Barry Schwartz, among others, and share our own.    Correction: At 56:24, Smriti mentions the book This is Biology, which is written by Ernst Mayr, not E.O. Wilson.    Shownotes Pavlov, I. (1936). Bequest of Pavlov to the Academic Youth of His Country. Science, 83(2155), 369–370. https://doi.org/10.1126/science.83.2155.369 Schwartz, B. (2022). Science, scholarship, and intellectual virtues: A guide t...
2023-07-141h 26Nullius in Verba
Nullius in VerbaEpisode 12: Virtutes VocationalisIn today's episode, we discuss vocational virtues⸺scientific principles that should guide the behavior of scientists. We discuss whether we agree with values put forth by numerous scientists, including Ivan Pavlov, Peter Medawar, Santiago Ramón y Cajal, Barry Schwartz, among others, and share our own.    Correction: At 56:24, Smriti mentions the book This is Biology, which is written by Ernst Mayr, not E.O. Wilson.    Shownotes Pavlov, I. (1936). Bequest of Pavlov to the Academic Youth of His Country. Science, 83(2155), 369–370. https://doi.org/10.1126/science.83.2155.369 Schwartz, B. (2022). Science, scholarship, and intellectual virtues: A guide t...
2023-07-141h 26Nullius in Verba
Nullius in VerbaPrologus 12: Science, Scholarship, and Intellectual Virtues (B.J. Schwartz)As prologue to the next episode on vocational virtues, we present a reading of a paper by Barry Schwartz:  Schwartz, B. (2022). Science, scholarship, and intellectual virtues: A guide to what higher education should be like. Journal of Moral Education, 51(1), 61-72.  https://doi.org/10.1080/03057240.2020.1772211  (Published online: 19 Jun 2020) You can read the paper here.  An episode from Smriti's previous podcast with Paul Connor where they discussed the paper with Barry can be found here.    
2023-07-0734 minNullius in Verba
Nullius in VerbaPrologus 12: Science, Scholarship, and Intellectual Virtues (B.J. Schwartz)As prologue to the next episode on vocational virtues, we present a reading of a paper by Barry Schwartz:  Schwartz, B. (2022). Science, scholarship, and intellectual virtues: A guide to what higher education should be like. Journal of Moral Education, 51(1), 61-72.  https://doi.org/10.1080/03057240.2020.1772211  (Published online: 19 Jun 2020) You can read the paper here.  An episode from Smriti's previous podcast with Paul Connor where they discussed the paper with Barry can be found here.    
2023-07-0734 minNullius in Verba
Nullius in VerbaEpisode 11: Inquisitionis VastumIn this episode, we discuss the topic of research waste. We discuss what it is it that is being wasted and whether we waste fewer scientific resources and talent through coordination, team science, and better planning.    Shownotes Bacon, New Atlantis, 1626: https://www.gutenberg.org/files/2434/2434-h/2434-h.htm  Dennett, D. C. (2006). Higher-order truths about chmess. Topoi, 25(1–2), 39–41. https://doi.org/10.1007/s11245-006-0005-2 Chalmers, I., & Glasziou, P. (2009). Avoidable waste in the production and reporting of research evidence. The Lancet, 374(9683), 86–89. Mao's Hundred Flowers Campaign: https://en.wikipedia.org/wiki/Hundred_Flowers_Campaign  Glasziou, P., & Chalmers, I. (2018...
2023-06-301h 10Nullius in Verba
Nullius in VerbaEpisode 11: Inquisitionis VastumIn this episode, we discuss the topic of research waste. We discuss what it is it that is being wasted and whether we waste fewer scientific resources and talent through coordination, team science, and better planning.    Shownotes Bacon, New Atlantis, 1626: https://www.gutenberg.org/files/2434/2434-h/2434-h.htm  Dennett, D. C. (2006). Higher-order truths about chmess. Topoi, 25(1–2), 39–41. https://doi.org/10.1007/s11245-006-0005-2 Chalmers, I., & Glasziou, P. (2009). Avoidable waste in the production and reporting of research evidence. The Lancet, 374(9683), 86–89. Mao's Hundred Flowers Campaign: https://en.wikipedia.org/wiki/Hundred_Flowers_Campaign  Glasziou, P., & Chalmers, I. (2018...
2023-06-301h 10Nullius in Verba
Nullius in VerbaPrologus 11: The Efficiency of Scientific Research (J.D. Bernal)In this bonus episode, Daniël reads Chapter 5 of John Desmond Bernal’s book The Social Function of Science, entitled The Efficiency of Scientific Research in preparation of our upcoming podcast episode on research waste. You can read The Social Function of Science by Bernal at the Internet Archive: https://archive.org/details/in.ernet.dli.2015.188098
2023-06-231h 34Nullius in Verba
Nullius in VerbaPrologus 11: The Efficiency of Scientific Research (J.D. Bernal)In this bonus episode, Daniël reads Chapter 5 of John Desmond Bernal’s book The Social Function of Science, entitled The Efficiency of Scientific Research in preparation of our upcoming podcast episode on research waste. You can read The Social Function of Science by Bernal at the Internet Archive: https://archive.org/details/in.ernet.dli.2015.188098
2023-06-231h 34Nullius in Verba
Nullius in VerbaEpisode 10: Probatio Significativitatis Hypothesis NihiliShownotes Wilson, E. B. (1923). The Statistical Significance of Experimental Data. Science, 58(1493), 93–100. https://doi.org/10.1126/science.58.1493.93 van Dongen, N. N. N., & van Grootel, L. (2021). Overview on the Null Hypothesis Significance Test. https://doi.org/10.31234/osf.io/hwk4n Stark, P. B., & Saltelli, A. (2018). Cargo‐cult statistics and scientific crisis. Significance, 15(4), 40-43. Uygun Tunç, D., Tunç, M. N., & Lakens, D. (2023). The epistemic and pragmatic function of dichotomous claims based on statistical hypothesis tests. Theory & Psychology, 09593543231160112. https://doi.org/10.1177/09593543231160112 Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66(6), 423–437. https://doi.org/10.1037/h0020412 Cohen, J. (1990). Things I have learned (so far). Am...
2023-06-161h 23Nullius in Verba
Nullius in VerbaEpisode 10: Probatio Significativitatis Hypothesis NihiliShownotes Wilson, E. B. (1923). The Statistical Significance of Experimental Data. Science, 58(1493), 93–100. https://doi.org/10.1126/science.58.1493.93 van Dongen, N. N. N., & van Grootel, L. (2021). Overview on the Null Hypothesis Significance Test. https://doi.org/10.31234/osf.io/hwk4n Stark, P. B., & Saltelli, A. (2018). Cargo‐cult statistics and scientific crisis. Significance, 15(4), 40-43. Uygun Tunç, D., Tunç, M. N., & Lakens, D. (2023). The epistemic and pragmatic function of dichotomous claims based on statistical hypothesis tests. Theory & Psychology, 09593543231160112. https://doi.org/10.1177/09593543231160112 Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66(6), 423–437. https://doi.org/10.1037/h0020412 Cohen, J. (1990). Things I have learned (so far). Am...
2023-06-161h 23Nullius in Verba
Nullius in VerbaEpisode 9: Praeiudicium PublicandiIn this episode, we discuss the issue of publication bias. We discuss issues like: Do we learn anything from null results, given the current state of research practices? Is poorly done research still worth sharing with the scientific community? And how can we move toward a system where null results are informative and worth publishing?   Shownotes Bones, A. K. (2012). We Knew the Future All Along Scientific Hypothesizing is Much More Accurate Than Other Forms of Precognition—A Satire in One Part. Perspectives on Psychological Science, 7(3), 307–309. https://doi.org/10.1177/1745691612441216 Carter, E. C., & McCullough, M. E. (2014). Publi...
2023-06-021h 07Nullius in Verba
Nullius in VerbaEpisode 9: Praeiudicium PublicandiIn this episode, we discuss the issue of publication bias. We discuss issues like: Do we learn anything from null results, given the current state of research practices? Is poorly done research still worth sharing with the scientific community? And how can we move toward a system where null results are informative and worth publishing?   Shownotes Bones, A. K. (2012). We Knew the Future All Along Scientific Hypothesizing is Much More Accurate Than Other Forms of Precognition—A Satire in One Part. Perspectives on Psychological Science, 7(3), 307–309. https://doi.org/10.1177/1745691612441216 Carter, E. C., & McCullough, M. E. (2014). Publi...
2023-06-021h 07Nullius in Verba
Nullius in VerbaEpisode 8: Scientia Cultus SarcinarumIn this episode, we discuss physicist Richard Feynman’s famous speech ‘Cargo Cult Science,’ which refers to work that has all the affectations of science without the actual application of the scientific method. We also discuss topics like: What is pathological science? How might cargo cult science and pathological be different from pseudo-science? How do we know whether or not we’re in a cargo cult, and what can we do to make sure we're not fooling ourselves?   Shownotes Cargo Cult Science (Feynman, 1974) Gergen, K. J. (1973). Social psychology as history. Journal of personality and social ps...
2023-05-191h 03Nullius in Verba
Nullius in VerbaEpisode 8: Scientia Cultus SarcinarumIn this episode, we discuss physicist Richard Feynman’s famous speech ‘Cargo Cult Science,’ which refers to work that has all the affectations of science without the actual application of the scientific method. We also discuss topics like: What is pathological science? How might cargo cult science and pathological be different from pseudo-science? How do we know whether or not we’re in a cargo cult, and what can we do to make sure we're not fooling ourselves?   Shownotes Cargo Cult Science (Feynman, 1974) Gergen, K. J. (1973). Social psychology as history. Journal of personality and social ps...
2023-05-191h 03Nullius in Verba
Nullius in VerbaPrologus 8: Cargo Cult Science (R.P. Feynman)In this bonus episode, we present a reading of the famous speech by physicist Richard Feynman on "science that isn't science," Cargo Cult Science, which will be the topic of the next episode. Enjoy. 
2023-05-1222 minNullius in Verba
Nullius in VerbaPrologus 8: Cargo Cult Science (R.P. Feynman)In this bonus episode, we present a reading of the famous speech by physicist Richard Feynman on "science that isn't science," Cargo Cult Science, which will be the topic of the next episode. Enjoy. 
2023-05-1222 minNullius in Verba
Nullius in VerbaEpisode 7: Corpora RegulatoriaIn this episode we discuss regulatory bodies their influence on the generation and dissemination of knowledge. Should regulatory bodies have the authority to affect the topics and methods of science? Is more highly regulated research actually better? And should we just give up on our own lines of research and become potato researchers?    Shownotes Kitcher, P. (2001). Science, truth, and democracy. Oxford University Press. Indian Council of Agricultural Research (ICAR)-Central Potato Research Institute (CPRI) Emergence of the NIH  DARPA SCORE Lakens, D. (2023). Is my study useless? Why researchers need methodological review boards. Nature, 613(7942), 9-9. PSA...
2023-05-0558 minNullius in Verba
Nullius in VerbaEpisode 7: Corpora RegulatoriaIn this episode we discuss regulatory bodies their influence on the generation and dissemination of knowledge. Should regulatory bodies have the authority to affect the topics and methods of science? Is more highly regulated research actually better? And should we just give up on our own lines of research and become potato researchers?    Shownotes Kitcher, P. (2001). Science, truth, and democracy. Oxford University Press. Indian Council of Agricultural Research (ICAR)-Central Potato Research Institute (CPRI) Emergence of the NIH  DARPA SCORE Lakens, D. (2023). Is my study useless? Why researchers need methodological review boards. Nature, 613(7942), 9-9. PSA...
2023-05-0558 minNullius in Verba
Nullius in VerbaEpisode 6: ConsentioIn this episode, we discuss the importance of consensus in science, both as means of establishing true knowledge and for determining which research questions might be worth pursuing. We also discuss barriers to reaching consensus and the different frameworks that are currently employed for trying to reach consensus among important stakeholders.  Shownotes The Popper quote is from: Popper, K. R. (1959). The logic of scientific discovery. Routledge. The Polanyi quote is from: Polanyi, M. (1950). Freedom in Science. Bulletin of the Atomic Scientists, 6(7), 195–198. https://doi.org/10.1080/00963402.1950.11461263 Planck's Principle: A new scientific truth does not triumph by con...
2023-04-2152 minNullius in Verba
Nullius in VerbaEpisode 6: ConsentioIn this episode, we discuss the importance of consensus in science, both as means of establishing true knowledge and for determining which research questions might be worth pursuing. We also discuss barriers to reaching consensus and the different frameworks that are currently employed for trying to reach consensus among important stakeholders.  Shownotes The Popper quote is from: Popper, K. R. (1959). The logic of scientific discovery. Routledge. The Polanyi quote is from: Polanyi, M. (1950). Freedom in Science. Bulletin of the Atomic Scientists, 6(7), 195–198. https://doi.org/10.1080/00963402.1950.11461263 Planck's Principle: A new scientific truth does not triumph by con...
2023-04-2152 minNullius in Verba
Nullius in VerbaEpisode 5: Insanabile Scribendi CacoethesIn this episode, we discuss the insatiable itch to publish, starting with a quote from 1927 by sociologist Clarence Case on the dictum “Publish or perish.” We discuss ways in which individual goals to publish conflict with the broader scientific goal of producing useful knowledge. We also question the assumptions behind the notion that publishing less would be beneficial for science.   Shownotes Case, C. M. (1927). Scholarship in sociology. Sociology and Social Research, 12, 323-340 (Publish or perish) Phaf, R. H. (2020). Publish less, read more. Theory & Psychology, 30(2), 263–285. https://doi.org/10.1177/0959354319898250 The term "insanabile scribendi cacoethes" comes f...
2023-04-071h 02Nullius in Verba
Nullius in VerbaEpisode 5: Insanabile Scribendi CacoethesIn this episode, we discuss the insatiable itch to publish, starting with a quote from 1927 by sociologist Clarence Case on the dictum “Publish or perish.” We discuss ways in which individual goals to publish conflict with the broader scientific goal of producing useful knowledge. We also question the assumptions behind the notion that publishing less would be beneficial for science.   Shownotes Case, C. M. (1927). Scholarship in sociology. Sociology and Social Research, 12, 323-340 (Publish or perish) Phaf, R. H. (2020). Publish less, read more. Theory & Psychology, 30(2), 263–285. https://doi.org/10.1177/0959354319898250 The term "insanabile scribendi cacoethes" comes f...
2023-04-071h 02Nullius in Verba
Nullius in VerbaEpisode 4: EminentiaIn this episode, we discuss the role of eminence in science. What ask questions like: What makes scientists eminent? What role does eminence play in science? Can eminence be spread across scientific teams instead of individuals? And how can we recognize and applaud scientists for their contributions, while avoiding conferring too many benefits on scientists who do become eminent?   Shownotes Eminent psychologists of the 20th century Intel - Our rock stars aren't like your rock stars
2023-03-2458 minNullius in Verba
Nullius in VerbaEpisode 4: EminentiaIn this episode, we discuss the role of eminence in science. What ask questions like: What makes scientists eminent? What role does eminence play in science? Can eminence be spread across scientific teams instead of individuals? And how can we recognize and applaud scientists for their contributions, while avoiding conferring too many benefits on scientists who do become eminent?   Shownotes Eminent psychologists of the 20th century Intel - Our rock stars aren't like your rock stars
2023-03-2458 minNullius in Verba
Nullius in VerbaEpisode 3: Confirmatio PraeiudiciaIn our third episode, we discuss confirmation bias, which affects not only how scientists generate and test their own hypotheses, but also how they evaluate the scientific evidence presented by others. We discuss guardrails against confirmation bias that are already in place, and others that could potentially improve scientific practice if adopted.    Shownotes Wason, P. C. (1960). On the failure to eliminate hypotheses in a conceptual task. Quarterly Journal of Experimental Psychology, 12(3), 129-140. Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2(2), 175-220. Mellers, B., He...
2023-03-101h 01Nullius in Verba
Nullius in VerbaEpisode 3: Confirmatio PraeiudiciaIn our third episode, we discuss confirmation bias, which affects not only how scientists generate and test their own hypotheses, but also how they evaluate the scientific evidence presented by others. We discuss guardrails against confirmation bias that are already in place, and others that could potentially improve scientific practice if adopted.    Shownotes Wason, P. C. (1960). On the failure to eliminate hypotheses in a conceptual task. Quarterly Journal of Experimental Psychology, 12(3), 129-140. Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2(2), 175-220. Mellers, B., He...
2023-03-101h 01Nullius in Verba
Nullius in VerbaEpisode 2: ScepticismusIn our second episode, we discuss the role of skepticism in science, a topic that relates closely to the title of our podcast. Given that the scientific enterprise is essentially an exercise in organized skepticism, how can we maintain a healthy amount of skepticism while also ensuring that scientists don't slip into cynicism or nihilism?    Shownotes Opening quote by Imre Lakatos from Science and Pseudoscience. Hear it from the man himself.  Ego depletion Ioannidis, J. P. (2005). Why most published research findings are false. PLoS Medicine, 2(8), e124. https://doi.org/10.1371/journal.pme...
2023-03-031h 05Nullius in Verba
Nullius in VerbaEpisode 2: ScepticismusIn our second episode, we discuss the role of skepticism in science, a topic that relates closely to the title of our podcast. Given that the scientific enterprise is essentially an exercise in organized skepticism, how can we maintain a healthy amount of skepticism while also ensuring that scientists don't slip into cynicism or nihilism?    Shownotes Opening quote by Imre Lakatos from Science and Pseudoscience. Hear it from the man himself.  Ego depletion Ioannidis, J. P. (2005). Why most published research findings are false. PLoS Medicine, 2(8), e124. https://doi.org/10.1371/journal.pme...
2023-03-031h 05Nullius in Verba
Nullius in VerbaEpisode 1: MotivusIn our first episode, we discuss a quote from the preface to The Instauratio Magna (of which Novum Organum is a part), in which Bacon claims that scientists should be motivated to do science for the betterment of mankind, and not for personal motives like fame, fortune, or even fun.  Here is the tweet (by Heidi Seibold) on academia not being aligned with good scientific practices.   An unedited transcript of the episode can be found here. 
2023-02-2455 minNullius in Verba
Nullius in VerbaEpisode 1: MotivusIn our first episode, we discuss a quote from the preface to The Instauratio Magna (of which Novum Organum is a part), in which Bacon claims that scientists should be motivated to do science for the betterment of mankind, and not for personal motives like fame, fortune, or even fun.  Here is the tweet (by Heidi Seibold) on academia not being aligned with good scientific practices.   An unedited transcript of the episode can be found here. 
2023-02-2455 minNullius in Verba
Nullius in VerbaEpisode 0: IntroductioIn this introductory episode, Daniël and Smriti share which podcasts they like, why they are starting their own, and how their connection to each other is also tied to podcasting. They also talk about the theme of the podcast, which is inspired by Francis Bacon’s delineation of the scientific method 400 years ago.
2023-02-1914 minNullius in Verba
Nullius in VerbaEpisode 0: IntroductioIn this introductory episode, Daniël and Smriti share which podcasts they like, why they are starting their own, and how their connection to each other is also tied to podcasting. They also talk about the theme of the podcast, which is inspired by Francis Bacon’s delineation of the scientific method 400 years ago.
2023-02-1914 minMore of a Comment Than a Question
More of a Comment Than a QuestionWaste Management (with Daniël Lakens)We chatted with Professor Daniël Lakens from TU Eindhoven about his recent proposal for universities to require scientists to submit their proposed research to methodological review boards before data collection. Read Daniël's proposal hereAnd check out the recent PNAS on the surprising generalizability of results from non-representative samples here
2023-01-081h 30Science+Story
Science+StoryDaniël Lakens: Red Teams for Research?To improve on peer review, social psychologist Daniël Lakens is subjecting research to a "red team" approach from software, where developers pay independent teams bounties to find bugs in their code. He even thinks red teaming your research could make communicating it easier by certifying its credibility.
2021-04-2438 minSped up Rationally Speaking
Sped up Rationally SpeakingRationally Speaking #123 - Daniel Lakens on P-Hacking and Other Problems in Psychology ResearchWhat's wrong with the social sciences? In this episode, Massimo and Julia are joined by Professor Daniel Lakens from the Eindhoven University of Technology, who studies psychology and blogs about research methods and open science. The three discuss why so many psychology papers can't be trusted, and what solutions might exist for the problem (including how to fix the skewed incentives in the field).  Sped up the speakers by ['1.13', '1.0']
2021-01-0243 minMore of a Comment Than a Question
More of a Comment Than a QuestionPower Struggles with Daniël LakensOn our first guest episode, we talk to our first (and only) fan, Daniël Lakens, an experimental psychologist at Eindhoven University of Technology. We talk about power analyses, sample size justification, SESOI, statistical 'heuristics,' and the broader culture in psychological science. Inspired by a twitter post by Josh Grubbs: https://twitter.com/JoshuaGrubbsPhD/status/1290652864415707139Daniël Lakens's blog, The 20% Statistician: https://daniellakens.blogspot.com/
2020-08-071h 25Learning Bayesian Statistics
Learning Bayesian Statistics#18 How to ask good Research Questions and encourage Open Science, with Daniel LakensHow do you design a good experimental study? How do you even know that you’re asking a good research question? Moreover, how can you align funding and publishing incentives with the principles of an open source science?Let’s do another “big picture” episode to try and answer these questions! You know, these episodes that I want to do from time to time, with people who are not from the Bayesian world, to see what good practices there are out there. The first one, episode 15, was focused on programming and python, thanks to Michael Kennedy. In this...
2020-06-1858 minLearning Bayesian Statistics
Learning Bayesian Statistics#18 How to ask good Research Questions and encourage Open Science, with Daniel LakensHow do you design a good experimental study? How do you even know that you’re asking a good research question? Moreover, how can you align funding and publishing incentives with the principles of an open source science?Let’s do another “big picture” episode to try and answer these questions! You know, these episodes that I want to do from time to time, with people who are not from the Bayesian world, to see what good practices there are out there. The first one, episode 15, was focused on programming and python, thanks to Michael Kennedy. In this...
2020-06-1858 minEverything Hertz
Everything Hertz100: Hundredth episode live special (with Daniel Lakens, Amy Orben, and Chris Chambers)To celebrate our 100th episode, which we video-streamed live, Dan and James were joined by three special guests: Daniel Lakens, Amy Orben, and Chris Chambers. Here's what they covered in this episode: James and Dan share their favourite episodes The power of the Twitter direct message Daniel Lakens joins us to discuss his recent work on helping people make better statistical decisions Can you create cross-discipline effect size guidelines? What would Jacob Cohen say if we could bring him back to life? Academic backup career plans Our new partnership with Prolific James' piece on not treating...
2020-01-271h 50Stuk Rood Vlees Podcast
Stuk Rood Vlees PodcastAflevering 7 (deel 2) - Daniël Lakens over wetenschapsfinanciering in NederlandArmen spreekt verder met psycholoog Daniël Lakens over de replicatiecrisis in de wetenschap en over de financiering van wetenschappelijk onderzoek in Nederland. Onderwerpen die in dit tweede deel aan bod komen zijn o.a. de Open Science Collaboration waar Daniël onderdeel van uitmaakt (3:40), de replicatie van Armen's eigen onderzoek door anderen (13:00), de schaduwzijde van de replicatierevolutie (20:20) en hoe onderzoeksgelden in Nederland verdeeld worden en hoe dat beter kan (30:42).
2018-08-1247 minStuk Rood Vlees Podcast
Stuk Rood Vlees PodcastAflevering 7 (deel 1) - Daniël Lakens over de replicatiecrisis in de wetenschapDaniël Lakens is een van de meest uitgesproken figuren in de replicatiebeweging in de wetenschap. In dit eerste deel komen we te spreken over Diederik Stapel, of Daniël wel eens zijn eigen werk heeft gerepliceerd (14:57), Publicatiebias (20:04), het bekendste geval van wetenschappelijke fraude in de politicologie van de afgelopen jaren (30:01), p-waardes en 'p-hacking' (39:55) en het ontstaan van de replicatiebeweging in de psychologie (49:00).
2018-08-0751 minEverything Hertz
Everything Hertz52: Give p's a chance (with Daniel Lakens)In this episode, Dan and James welcome back Daniel Lakens (Eindhoven University of Technology) to discuss his new paper on justifying your alpha level. Highlights: Why did Daniel write this paper? Turning away from mindless statistics Incremental vs. seismic change in statistical practice The limitations to justifying your alpha The benefits of registered reports Daniel’s coursera course What’s better? Two pre-registered studies at .05 or one unregistered study at .005? Testing at the start of semester vs. the end of semester Thinking of controlling for Type 1 errors as driving speed limits Error rates mean different things betw...
2017-10-201h 02Everything Hertz
Everything Hertz43: Death, taxes, and publication bias in meta-analysis (with Daniel Lakens)Daniel Lakens (Eindhoven University of Technology) joins James and Dan to talk meta-analysis. Here’s what they cover: Daniel’s opinion on the current state of meta-analysis The benefit of reporting guidelines (even though hardly anyone actually follows them) How fixing publication bias can fix science Meta-analysis before and after that Bem paper How to correct for publication bias Whether meta-analyses are just published for the citations The benefits of pre-registering meta-analysis How we get people to share their data How sharing data doesn’t just benefit others - it also helps you replicate your own analys...
2017-05-051h 02Everything Hertz
Everything Hertz42: Some of my best friends are Bayesians (with Daniel Lakens)Daniel Lakens (Eindhoven University of Technology) drops in to talk statistical inference with James and Dan. Here’s what they cover: How did Daniel get into statistical inference? Are we overdoing the Frequentist vs. Bayes debate? What situations better suit Bayesian inference? The over advertising of Bayesian inference Study design is underrated The limits of p-values Why not report both p-values and Bayes factors? The “perfect t-test” script and the difference between Student’s and Welch’s t-tests The two-one sided test Frequentist and Bayesian approaches for stopping procedures Why James and Dan started the podcast The worst...
2017-04-211h 07Rationally Speaking Podcast
Rationally Speaking PodcastRationally Speaking #123 - Daniel Lakens on P-Hacking and Other Problems in Psychology ResearchWhat's wrong with the social sciences? In this episode, Massimo and Julia are joined by Professor Daniel Lakens from the Eindhoven University of Technology, who studies psychology and blogs about research methods and open science. The three discuss why so many psychology papers can't be trusted, and what solutions might exist for the problem (including how to fix the skewed incentives in the field).
2014-12-1445 min