Look for any podcast host, guest or anyone
Showing episodes and shows of

Dan Quintana

Shows

Everything Hertz
Everything Hertz193: The pop-up journalDan and James chat about a a new 'pop-up journal' concept for addressing specific research questions. They also answer a listener question from a journal grammar editor and discuss a new PNAS article on paper mills Links The pop-up journal The episode where Dan's wife went into labor The PNAS paper mill paper A blog post from the PNAS paper lead author, Reese Richardson. The Nature piece on the paper Social media links Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Citation Quintana, D. S., & Heathers, J. (2025, August 7). 193: The...
2025-08-0759 minEverything Hertz
Everything Hertz192: Outsourcing in academiaDan and James answer listener questions on outsourcing in academia and differences in research culture between academic institutions and commercial institutions. Social media links Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Citation Quintana, D. S., & Heathers, J. (2025, July 1). 192: Outsourcing in academia, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/3MC2RSupport Everything Hertz
2025-07-0147 minEverything Hertz
Everything Hertz191: Cleaning up contaminated medical treatment guidelinesJames and Dan discuss James' newly funded 'Medical Evidence Project', whose goal is to find questionable medical evidence that is contaminating treatment guidelines. Links James' blog post from last year The carthorse child blog post The blog post announcing the project A write up in Nature about the project Other links Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Citation Quintana, D. S., & Heathers, J. (2025, June 4). 191: Cleaning up contaminated medical treatment guidelines Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/537BNSupport Everything Hertz
2025-06-0348 minEverything Hertz
Everything Hertz189: Crit me baby, one more timeDan and James discuss a recent piece that proposes a post-publication review process, which is triggered by citation counts. They also cover how an almetrics trigger could be alternatively used for a more immediate post-publication critique. Links The Chonicle piece by Andrew Gelman and Andrew King [Free to read with email registration] The paper by Peder Isager and collegues on how to decide what papers we should replicate. Here is the preprint. The ERROR project Other links Everything Hertz on Bluesky Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Citation
2025-03-0253 minEverything Hertz
Everything Hertz188: Double-blind peer review vs. scientific integrityDan and James discuss a recent editorial which argues that double-blind peer review is detrimental to scientific integrity. Links The editorial from Christopher Mebane: https://doi.org/10.1093/etojnl/vgae046 Other links Everything Hertz on Bluesky Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier PLUS...
2025-01-3054 minEverything Hertz
Everything Hertz185: The RetractionWe discuss the recent retraction of a paper that reported the effects of rigour-enhancing practices on replicability. We also cover James' new estimate that 1 out of 7 scientific papers are fake. Links The story about data integrity concerns in 130 women’s health papers James' new preprint with the estimate that 1 out of 7 scientific papers are fake The retracted paper in Nature Human Behavior by Protzko and coworkers The Matters Arising article from Bak-Coleman and Devezer, who initially raised concerns about the paper from Protzko and coworkers. The Everything Hertz merch store The paper about puns/jokes in pa...
2024-10-041h 08Everything Hertz
Everything Hertz183: Too beautiful to be trueDan and James discuss a paper describing a journal editor's efforts to receive data from authors who submitted papers with results that seemed a little too beautiful to be true Main edisode takeaways (AI generated summary) This editorial on the reproducibility crisis emphasizes the importance of providing raw data in scientific publications and highlights the need for transparency and accountability in the research process The lack of oversight and the discrepancy between the amount of data required for scientific statements and what is often provided in academic publishing is a cause for concern. Ensuring the integrity...
2024-08-0345 minEverything Hertz
Everything Hertz182: What practices should the behavioural sciences borrow (and ignore) from other research fields?Dan and James answer a listener question on what practices should the behavioural sciences borrow (and ignore) from other research fields. Here are the main takeaways: Keeping laboratory records and using electronic lab management software is beneficial practices biology that would benefit the behavioral sciences The rate of pre-registration of meta-analysis in psychology is low, unlike other fields, which have a higher pre-registration rate. Here is the preprint on pre-registration of psychology meta-analyses that was mentioned: https://doi.org/10.31222/osf.io/627a4 Case studies (somewhat common in medicine) can provide valuable insights, especially when there is...
2024-07-0251 minEverything Hertz
Everything Hertz180: Consortium peer reviewsDan and James discuss why innovation in scientific publishing is so hard, an emerging consortium peer review model, and a recent replication of the 'refilling soup bowl' study. Other things they cover and links: Which studies should we spend time replicating? The business models of for-profit scientific publishers How many tacos can you buy with the money it costs to publish open access in Nature? The original soup bowl study: https://doi.org/10.1038/oby.2005.12 The replication study: https://doi.org/10.1037/xge0001503 The Peer Community In initiative: https://peercommunityin.org/ Stuart Buck's newsletter: https://goodscience.substack.com
2024-05-0250 minEverything Hertz
Everything Hertz179: Discovery vs. maintenanceDan and James discuss how scientific research often neglects the importance of maintenance and long-term access for scientific tools and resources. Other things they cover: Should there be an annual limit on publications (even if this were somehow possible)? The downsides of PhD by publication The Gates Foundation's new Open Access policy Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to...
2024-04-0348 minEverything Hertz
Everything Hertz178: Alerting researchers about retractionsDan and James discuss the Retractobot service, which emails authors about papers they've cited that have been retracted. What should authors do if they discover a paper they've cited has been retracted after they published their paper? Other things they chat about A listener question about including examiner's comments in thesis The different types of retractions and thier impact Why aren't versioning systems more common in scientific publishing? Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on...
2024-02-2949 minEverything Hertz
Everything Hertz173: How do science journalists evaluate psychology papers?Dan and James discuss a recent paper that investigated how science journalists evaluate psychology papers. To answer this question, the researchers presented science journalists with fictitious psychology studies and manipulated sample size, sample representativeness, p-values, and institutional prestige Links The paper on how science journalists evaluate psychology papers The preprint paper on small samples Laboratory Life by Bruno Latour Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20...
2023-10-0135 minEverything Hertz
Everything Hertz172: In defence of the discussion sectionDan and James discuss a recent proposal to do away with discussion sections and suggest other stuff they'd like to get rid of from academic publishing. Links The paper on the proposed elimiation of the discussion section The paper on machine readable hypothesis tests Our episodes with Daniel Lakens Our episode with Lisa DeBruine Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the...
2023-08-3135 minEverything Hertz
Everything Hertz168: Meta-meta-scienceDan and James discuss a new paper that reviews potential issues in metascience practices. They also talk about their upcoming live show in May in Frankfurt. Links Our upcoming show on May 8th, which will be a part of the at the 4th symposium on big data and research syntheses in psychology symposium to be held in Frankfurt, Germany The paper we discuss from Mark Rubin Peder Isager and team's paper on what to replicate Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything...
2023-04-2748 minEverything Hertz
Everything Hertz167: Diluted effect sizesDan and James chat about a new study that uses homeopathy studies to evaluate bias in biomedical research, a new-ish type of authorship fraud, and the potential for Chat GPT peer-review. Links The Chat GPT paper library tweet The Homeopathy paper The David Grimes paper British dental journal paper on fraud The AHealthcareZ YouTube channel The FittDesign Studio YouTube channel Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month...
2023-03-1643 minEverything Hertz
Everything Hertz166: Is science becoming less disruptive over time?Dan and James discuss a recent paper that claims that science is becoming less disruptive over time and the suggested causes for this decline. Links Our prior episode, which discussed PhD defences The paper on disruption in science The news piece on the paper Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm...
2023-01-2552 minEverything Hertz
Everything Hertz165: Self-promotionDan and James chat about self-promotion in academia, how they both wish they had doctoral defences (these aren't a thing in Australia), and replacing error bars with the letter "t". Links and stuff The now retracted paper with the error bars as "t"s A direct link to the figure The blog post on self-promotion, titled "The End of Decency: When Self-Promotion Goes Too Far" https://www.insidehighered.com/advice/2022/12/09/why-too-much-public-self-promotion-academics-damaging-opinion Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook ...
2022-12-3041 minEverything Hertz
Everything Hertz164: The great migrationJames and Dan discuss the recent migration of scientists from Twitter to Mastodon and the pros and cons of sharing the prior submission history of manuscripts The Mastodon thread discussion the submission history policy in American Chemical Society Journals The "Weekend at Bernies" film Our new Mastodon account: @hertzpodcast@mas.to James' leaf blower man haiku Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise...
2022-11-2849 minEverything Hertz
Everything Hertz163: eLife's new peer review modelDan and James discuss eLife's new peer review model, in which they no longer make accept/reject decisions at the end of the peer-review process. Instead, papers invited for peer review will receive an assessment from eLife and the peer reviews will be shared on eLife's website. It's up to author if they would like revise their manuscript or publish their paper as the version of record. eLife's announment A editorial from Michael Eisen and team Episode 122: Reoptimizing scientific publishing for the internet age (with Michael Eisen) Episode 123: Authenticated anonymity (with Michael Eisen) A paper describing p-rep ...
2022-11-0754 minEverything Hertz
Everything Hertz162: Status bias in peer reviewWe chat about a recent preprint describing an experiment on the role of author status in peer-review, dodgy conference proceedings journals, and authorships for sale. Links James' blogpost on conference proceedings journals The preprint/working paper on status bias Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or...
2022-10-1750 minEverything Hertz
Everything Hertz161: The memo (with Brian Nosek)Dan and James are joined by Brian Nosek (Co-founder and Executive Director of the Center for Open Science) to discuss the recent White House Office of Science Technology & Policy memo ensuring free, immediate, and equitable access to federally funded research. They also cover the implications of this memo for scientific publishing, as well as the mechanics of culture change in science. Open Science Framework hits half a million users The White house memo Brian on Twitter Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz...
2022-09-1247 minEverything Hertz
Everything Hertz160: WhistleblowingDan and James share ten rules for whistleblowing academic misconduct. The Safe Faculty Project website SLAPP statues https://en.wikipedia.org/wiki/Strategic_lawsuit_against_public_participation Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show $5 per month or more: All the stuff you get in the one dollar tier...
2022-08-3150 minEverything Hertz
Everything Hertz159: Peer review isn't working (with Saloni Dattani)Dan and James are joined by Saloni Dattani for a chat about the history of peer review, a reimagination of what peer review could look like, what happens when you actually pay peer reviewers, peer reviewer specialisation, post publication peer review, annual paper limits for authors, automation in peer review, and Big Cheese. Links Works in Progress magazine One of the many news stories about the Jarsberg cheese study The actual study Saloni's peer review piece The F1000 format Our episode with Elisabeth Bik PCI registered reports Saloni on Twitter Other links Everything Hertz...
2022-08-1551 minEverything Hertz
Everything Hertz158: Word limitsBy popular demand, Dan and James chat about journal word and page limits.They also the debate around a recent meta-analysis on nudge interventions. Links The PNAS nudge meta-analysis The response letter The paper on adjectives and adverbs in life sciences Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting...
2022-08-0145 minEverything Hertz
Everything Hertz157: LimitationsDan and James discuss a new preprint that examined the types of limitations authors discuss in their published articles and whether these limitation types has changed over the past decade, especially in light of methodological reform efforts. Links The Genetic Lottery by Kathryn Paige Harden The limitations preprint by Beth Clarke and collegues Simine Vazire’s episode (also known as the one where Dan's wife starts going into labor) The heartbeat paper from Galvez-Pol and collegues Rand Wilcox and robust statistical methods The tweet thread explainer from Beth Clarke Other links Everything Hertz on so...
2022-07-1146 minEverything Hertz
Everything Hertz156: Looking for seedersDan and James discuss a recent paper that concluded (again) that most researchers aren't compliant with their published data sharing statement and whether torrents (remember them?) are a viable alternative for sharing large datasets. Links The data request paper The paper Dan and James co-authored led by Julian Koenig Our episode with Henry Drysdale Our episode with Chris Chambers The meta-psychology journal Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook ​ Support us on Patreon and get bonus stuff! ​ $1 per month: A 20...
2022-06-2150 minEverything Hertz
Everything Hertz155: Don't you know who I am?We chat about appeals to authority when responding to scientific critique, university ranking systems, Goodhart’s law (and its origin), and private institutional review boards. Links The history of Goodhart's law The original psychadelics paper in Nature Medicine The critique The response to the critique Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus episode, and the the wa...
2022-05-3046 minEverything Hertz
Everything Hertz154: When the evidence is constructed around the narrativeWe chat about the Theranos story and the parallels with academic research, as well as Twitter's new owner and whether academics will actually leave the platform Links Mastodon (the band) Elon Musk’s Onion article The Dropout podcast The Juicero Bad Blood: The Final Chapter podcast by John Carreyrou  "Macho Man" Randy Savage Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to...
2022-05-0951 minEverything Hertz
Everything Hertz153: Shame shame shameWe discuss a journal's new "wall of shame" page, which details unethical behaviours in an effort to discourage future misconduct. We also cover scientific ideas that won't die (but one idea that HAS died), and ECNP's "negative data" prize The audio quality of this recording isn't up to our usual standards as we were both travelling and without our normal recording gear. We'll be back with our normal gear next episode! Links James’ letter to the editor/obituary on sympathovagal balance The Mirror neuron book that Dan mentioned The Wall of Shame page An ar...
2022-04-1847 minEverything Hertz
Everything Hertz152: Sorry Not SorryJames and Dan chat about apologies vs. non-apologies, how to decide when to call it quits on a paper, and governments vetoing research proposals recommended by their own funding agencies Links for stuff we mention The tweet from Chris Jackson that started it all Chris Jackson's Hertz episode on the cumulative advantage of academic capital The Science Diagrams that Look Like Shitposts twitter account Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per...
2022-04-0455 minEverything Hertz
Everything Hertz151: The dirty dozenDan and James discuss a new preprint that details twelve p-hacking strategies and simulates their impact on false-positive rates. They also discuss the Great Resignation in academia and the academic job market. Links The twitter discussion on Associate editor pay kicked off by Eiko Fried The p-hacking paper from Angelika Stefan and Felix Schönbrodt The sample size preprint from Daniel Lakens Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% d...
2022-03-2139 minEverything Hertz
Everything Hertz150: Why can't you do nothing?We discuss the latest paper to seriously use the Kardashian index, which is the discrepancy between a scientist's publication record and social media following, and a listener question on whether original authors should get the last word when a comment on an article is submitted Links The paper on citation impact and social media visibility of Great Barrington and John Snow signatories for COVID-19 strategy The Rapid Responses comments on the paper The peer review reports for the paper Send us an audio question! About PubPeer Everything Hertz on social media Dan on twitter ...
2022-02-2852 minEverything Hertz
Everything Hertz149: Medical misinformation (with Rohin Francis)Dan and James chat with cardiologist Rohin Francis about medical misinformation and how he uses YouTube for science communication via his 'Medlife Crisis' channel. Links to stuff that was mentioned: Rohin's YouTube channel Rohin on Twitter Can you be so fit that you die video? Why does getting in the water want to make you pee video What is the stupidest nerve in the body video Can you legally buy a human skeleton video The Tibbies YouTube channel Up and atom YouTube Channel Belinda Carr YouTube Channel Everything Hertz on social media Dan on...
2022-02-1456 minEverything Hertz
Everything Hertz148: Academic reference lettersDan and James chat about why academic reference letters are terrible, a recent position statement on preprints, and whether the "great resignation" is also happening in academia. Links to stuff that was mentioned: The tweet from Dr. Eliza Bliss-Moreau on acedemic reference letter The tweet from Gilad Feldman about the 100 references he's submitted in 2020 alone The AMWA-EMWA-ISMPP joint position statement paper on medical publications, preprints, and peer review, Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get...
2022-01-3151 minEverything Hertz
Everything Hertz147: The $7000 golden ticketWe discuss the $7000 'accelerated publication' option for some Taylor & Francis journals that promises 3-5 week publication and a novel type of research fellowship. Details for the accelerated publication The New Science 2022 Summer Fellowship We have new merch! Use the discount code 'METAL' to get 20% off (valid until January 31st, 2022). Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, a monthly newsletter, access to the occasional bonus...
2022-01-1754 minEverything Hertz
Everything Hertz146: Skills pay billsWe answer a series of questions from a listener on whether to start a PhD, what to ask potential supervisors, the financial perils of being a PhD student, the future of higher education, the importance of skills, what keeps us going, and more. Here are the specific questions that we answered in this episode (the background to these questions is shared in the episode): Would you have any advice on how I can even decide whether to commence a PhD? Are there any questions in particular that you think are important to ask prospective supervisors? How...
2021-12-271h 09Everything Hertz
Everything Hertz145: Our boat is sinking slightly slowerWe discuss the results from the cancer biology reproducibility project, the inevitable comparisons with reproducibility in psychology, and authorship expectations for posting public datasets. Links The paper investigating the replicability of preclinical cancer biology The paper on the impact of alphabetical order on career outcomes in economics (whose authorship order are determinedby alphabetical order That human sports science paper that inlcluded a cranionotomy Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month...
2021-12-1348 minEverything Hertz
Everything Hertz144: The role of luck in academiaIf your child asked you whether they should pursue a career in academia, what would you say? We discuss this question plus three more quick-fire topics: the death of expertise, memorable presentations, and including internships in more graduate programs Links Get a 30% discount on a Scite subscription for a year, just use the coupon code EVERYTHINGHERTZ via this link The “Remind me of this later” twitter bot The Chase, Chance, and Creativity book Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Supp...
2021-11-1553 minEverything Hertz
Everything Hertz143: A little less conversation, a little more actionDan and James discuss the differences between 'talk' and 'action' in scientific reform and why reforms are taking such a long time to be realised. They also chat about whether messy (but correct) code is worse than no code at all, and revisit the grad student who never said "no". Other links Get a 30% discount on a Scite subscription for a year, just use the coupon code EVERYTHINGHERTZ via this link James' blog post on why he loves preprints The grad student who never said "no" (archived) blog post Everything Hertz on social media ...
2021-11-0154 minEverything Hertz
Everything Hertz142: Red flags in academia [Live episode]In this live episode, Dan and James discuss red flags in academia, in terms of research fields, papers, and individuals. Thanks to everyone that participated in this live event! Links to stuff that was mentioned Get a 30% discount on a Scite subscription for a year, just use the coupon code EVERYTHINGHERTZ via this link The p-hacker app Burro racing on Wikipedia Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount...
2021-10-1857 minEverything Hertz
Everything Hertz141: Why we should diversify study samples (with Sakshi Ghai)We chat with Sakshi Ghai (University of Cambridge) about why we should diversify sample diversity and retire the Western, educated, rich, industrialized and democratic (WEIRD) dichotomy in the behavioral sciences Links to stuff we discuss: Sakshi's piece in Nature Human Behavior Many Labs 2 paper The ‘helicopter' research piece Joseph Heinrich’s recent book, The WEIRDest People in the World Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hert...
2021-10-0457 minEverything Hertz
Everything Hertz140: You can’t buy cat biscuits with ‘thank you’ emailsJames proposes that peer review reports should be published as their own citable objects, provided that the manuscript author thinks that the peer review report is of sufficient quality and the peer reviewers agree Other links and things we discuss An update on James’ start up job The American service industry Dan’s first outing since the pandemic started The villlage of Hell, in Norway The villiage of Fucking (now changed to Fugging) in Austria The Hertz long term archive on Open Science Framework We’re up for doing a syllabus episodes that you can assign to you...
2021-09-201h 01Everything Hertz
Everything Hertz139: Open science from a funder's perspective (with Ashley Farley)We chat with Ashley Farley about her background as an academic librarian, the underrecognised importance of copyright in academic publishing, and her work as a Program Officer at the Gates Foundation An academic librarian’s perpsective on the importance of open reseasch The importance of copyright in research and what it means signing over your copyright The PDF crisis! What does a program officer at a grant funding organsiation do? Why should funding organisations care about open science? Why open access is more than just about acacemic papers, but extends to posters and presentations Why can't academics collectively de...
2021-09-0656 minEverything Hertz
Everything Hertz138: Preprints in the time of coronavirus (with Michele Avissar-Whiting)We chat with Michele Avissar-Whiting about her role as the Editor-in-chief of the Research Square preprint platform and how she weighs up the benefits and costs of potentially problematic preprints during a pandemic. Notes, links, and stuff we cover: The Journal Ghoul reference in the intro Michele’s role as a the editor for a preprint server How Research Square works Weighing up the urgency of preprints vs. potential danger The preprint-to- hype pipeline The Scholarly Kitchen piece on knowledge democratization Badges for preprints The recent withdrawal of a preprint Other links Everything He...
2021-08-161h 06Everything Hertz
Everything Hertz137: Ten rules for improving academic work-life balanceDan and James share their thoughts on a recent paper that proposes ten rules for improving academic work-life balance for early career researchers and the figure from this paper that became a meme. Here are the rules: Long hours do not equal productive hours Examine your options for flexible work practices Set boundaries to establish your workplace and time Commit to strategies that increase your efficiency and productivity Have a long-term strategy to help with prioritization, and review it regularly Make your health a priority Regularly interact with family and friends Make time for volunteer work...
2021-08-0253 minEverything Hertz
Everything Hertz136: Who peer-reviews the peer-reviewed journals?We discuss Journal Reviewer (journalreviewer.org), which is a website that provides a forum for researchers to share and rate their experiences with journal's peer review processes. We also cover how some journals negotiate the way in which their impact factors are calculated. Links The reference to James' mention of Dick Whittington James’ RIOT science talk Nichola's Raihani's tweet https://journalreviewer.org/ The South Park Yelp episode Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Pa...
2021-07-1950 minEverything Hertz
Everything Hertz135: A loss of confidenceDan Quintana and James Heathers chat about well-known psychology studies that we've now lost confidence in due to replication failures and the role of auxiliary assumptions in hypothesis-driven research. Other links The reversals in psychology website Anne Scheel and team's paper on whether you’re ready to test hypotheses Homer Simpson burning bridges meme The paper that suggests replications will make psychology too boring and nobody will want to study it Daniel Lakens’ blog post on the hungry judges study Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twit...
2021-07-0550 minEverything Hertz
Everything Hertz134: Paywalled questionnairesWe discuss a recent retraction triggered by the authors not paying a copyright fee to use a questionnaire (that also happened to be critical of the original questionnaire). Links for stuff that we mention: The paper that was retracted for not getting the correct licence for a questionnaire The retraction notice for this paper The Spectrum piece that discusses this story Why most online recipes begin with some ridiculous story Libkey, which provides one-click access to papers via your institutional library subscription Everything Hertz on social media Dan on twitter James on twitter Everything...
2021-06-2156 minEverything Hertz
Everything Hertz133: Manuscript submission feesSome journals use nominal manuscript submission fees to discourage frivolous submissions. However, it has been suggested that increasing submission fees could reduce article processing charges. Dan and James discuss this proposal, along with the recently released code of conduct for scientific integrity from the Swiss Academies of Arts and Sciences. James’ Atlantic piece Submission fees for mansucripts The scholarly kitchen blog post We have a new partner: Paperpile! Our PeerJ episode with Jason Hoyt The code of conduct for scientific integrity from the Swiss Academies of Arts and Sciences Everything Hertz on social media Dan on tw...
2021-06-0749 minEverything Hertz
Everything Hertz132: Post-pandemic academiaDan and James discuss how academia should operate in a post-pandemic world. What pandemic practices should we keep and what should we abandon? Links and details: Quiz: Norwegian metal band or Norwegian town? Things are slowly getting back to normal in some (but not alI) countries. So what academic practices and routines should we keep from the pandemic and what should we kiss goodbye? Would it be possible to be physically located at your local university but to be employed/educated at another university? Video abstracts are now an option is some journals, here's an example ...
2021-05-1750 minEverything Hertz
Everything Hertz131: Long live the overhead projector!Dan and James answer listener audio questions on indirect costs for research grants, the mind/body problem, and why many academics aren't trained to teach. They also profess their love for the overhead projector Some more details: Should we require universities to justify overhead costs, like heating and electricity? Overheads can inflate the costs of grants, some grants provide an additional percentage for overheads but others don’t allow this, which can eat into grants Get to know the people in your local grant office! Indirect costs at MIT A primer on indirect costs and why th...
2021-05-031h 03Everything Hertz
Everything Hertz130: Normalizing retractions (with Dorothy Bishop)Dan and James chat with Dorothy Bishop (University of Oxford) about the importance of normalizing the retraction of scientific papers, publication ethics, and whether paper mills (companies that make fake papers at scale) are an issue in the psychological sciences Here are some links and stuff we covered: Dorothy's thoughts on how the adoption of open science practices has been progressing since we last had her on the show in June 2018 The European Research Council's new open access journal, which is free to publish in if you're ERC funded Dan's proposal of something similar in a 2019...
2021-04-191h 00Everything Hertz
Everything Hertz129: Transparency auditsDan and James discuss the recently proposed "transparency audit", why it received so much blowback, and the characteristics of successful reform schemes The specifics... The computational research integrity conference The transparancy leaderboard proposed by Curate Science Our episode with Chris Jackson, that James mentioned What about a transparency leaderboard for instiutions? What are the characteristics of grassroots reform schemes that worked? Other links [Dan on twitter](www.twitter.com/dsquintana) [James on twitter](www.twitter.com/jamesheathers) [Everything Hertz on twitter](www.twitter.com/hertzpodcast) [Everything Hertz on Facebook](www.facebook.com/everythinghertzpodcast/) ...
2021-04-0556 minEverything Hertz
Everything Hertz128: How do you generate new research ideas?Dan and James chat about how they come up with new ideas, why everyone seems to be trying to monetise their hobbies, and why it's so hard for most labs to have a singular focus of research. We had some problems with James' mic so the quality of his audio wasn't up our usual standard. To make up for this we've added one of our older bonus episodes at the end of this conventional episode (this begins at 54:18). These bonus episodes are typically only made available for our Professor Fancypants Patreon patrons, but now you'll get to...
2021-03-151h 11Everything Hertz
Everything Hertz126: The division of scientific labor (with Saloni Dattani)We have a wide-ranging chat with Saloni Dattani (Kings College London and University of Hong Kong) about the benefits of dividing scientific labor, the magazine she co-founded (Works in Progress) that shares novel ideas and stories of progress, and fighting online misinformation Here are some links and other stuff we cover Follow Saloni on Twitter: https://twitter.com/salonium Why Saloni started the Works in Progress magazine [Overleaf](overleaf.com), for writing papers in LaTeX How science will benefit from the division of labour Public writing vs. scientific writing Why has behavioral science not been very...
2021-02-1552 minEverything Hertz
Everything Hertz125: Upon reasonable requestDan has a blue-sky proposal to increase data sharing—that funders mandate scholars to store and analyse data on their servers for which the funder decides what constitutes a reasonable data request (among other benefits) Other stuff covered: We return with part 2 of "overrated/underrated/appropately rated", in which James throws nouns at Dan and he responds with whether these things are overrated, underrated, or appropately rated. Joe Hilgard's blog post Dan' proposal that funders should require all funded researchers to store and perform their analysis on a central server, which would make it easier to sh...
2021-02-0146 minEverything Hertz
Everything Hertz124: From Ptolemy to Takeshi's CastleWe discuss under which circumstances retracting decades-old articles is worth the time. We also chat about why LinkenIn is underrated (yes, really) and special journal issues are overrated. A more specific list of topics and links: We play a game of "overated/underated", in which Dan has a list of stuff that he asks James whether these things are overrated or underated (or appropiated rated) Why LinkedIn is underated Graphical abstracts are underrated Online conferences are underrated Authors should have the chance to wildly speculate (as long as it's marked as wild speculation) Sourdough bread is...
2021-01-1851 minEverything Hertz
Everything Hertz122: Reoptimizing scientific publishing for the internet age (with Michael Eisen)The internet should have transformed science publishing, but it didn't. We chat with Michael Eisen (Editor-in-Chief of eLife) about reoptimizing scientific publishing and peer review for the internet age. Here what we cover and some links: How Michael co-founded PLOS The book Dan mentioned on the history of the scientific journal Why did eLife launch? What did it offer that other journals didn't? Nature's recently proposed $11k article processing fee proposal eLife's new "author-driven publishing" approach, in which all submitted papers have to be posted as preprints Part two of our conversation will be released on...
2020-12-2140 minEverything Hertz
Everything Hertz121: Transparent peer reviewDan and James discuss the pros and cons of transparent peer-review, in which peer review reports are published alongside manuscripts, as a keynote feature at the recent Munin Conference on scholarly publishing. Here's what they cover and some links: Watch the video of this episode on the Everything Hertz YouTube page What is transparent peer-review? The permanancy of open peer review reports CLOCKSS provides a sustainable dark archive to ensure the long-term survival of Web-based scholarly content Open peer reviews provide additional info for historians What changes when you know that your review is going to...
2020-12-0757 minEverything Hertz
Everything Hertz120: How false beliefs spread in science (with Cailin O'Connor)Dan and James chat with Cailin O'Connor (University of California, Irvine) about the how false beliefs spread in science and remedies for this issue Here's what they cover: Why should psychologist scientists learn about the philosophy of science? Cailin's new preprint on error propogation that she co-authrored Boyd and Richerson's "Culture and the Evolutionary Process" book Episode 91 with Kristin Sainani that discussed magnitude based inference Christie Aschwanden on Magnitude Based Inference The Misinformation age, co-authored by Cailin Cailin's paper on the retraction of scientific papers With Scite, you can be alterted whether a given paper has...
2020-11-1647 minEverything Hertz
Everything Hertz119: Rules of thumbDan and James discuss how rules of thumbs in science, such as those often applied to sample sizes and effect sizes, lead to mindless research evaluation. More info and links: Is there any justifcation for holding back the public posting of data becuase you're not done with your analyses We have a new episode partner, Scite! Scite helps researchers quickly see how a research paper has been cited and if it has been supported or disputed by subsequent research Get a 30% discount on a 12-month Premium Scite subscription. Use the coupon code: HERTZ (offer expires January 1, 2021) ...
2020-11-0256 minEverything Hertz
Everything Hertz118: Evidence-free gatekeepingDan and James answer audio listener questions on the worst review comments they've received (and how the responded), their thoughts on the current state of preprints, and how institutional prestige influences researcher evaluations. Other points and links: Send in your audio question at our website Listen to our episode with Chelsea Parlett-Pelleriti, on memes, TikTok, and science communication The worst peer reviewers we have received How do we respond to bad peer review comments The Research Square preprint server The current state of preprints The 'readiness scale' paper at Nature Human Behavior How the prestige of...
2020-10-191h 04Everything Hertz
Everything Hertz117: How we peer-review papersDan and James choose a preprint and walk through how they would peer-review it. James also provides an update on his recent proposal that scientists should be paid for performing peer reviews for journals published by for-profit companies Specific links and topics: An update on the 450 movement, which proposes that scientists should be paid for performing peer reviews for journals published by for-profit companies You should follow Overly Honest Editor on Twitter The Volkswagen fellowships Emma Mills, from Lancaster University, asks us how we review papers We review this paper: "Direct perception of other people’s he...
2020-10-051h 04Everything Hertz
Everything Hertz116: In my opinionDan and James chat about a recent twitter discussion on open science funding and the benefits of Editors sharing their opinions online. James also shares three project proposals that he thinks deserves funding, which Dan ranks. Other stuff... The Twitter thread from Tage Rai on conflicts of interest in funding on science The Raytheon Amphitheater at Northeastern University How Nature Human Behavior evaluates your mansucripts, from episode 105. Good and bad experiences with Frontiers journals A contract for getting paid for reviews Get access to our Patreon newsletter The peer-review process at eLife James' three grant proposal...
2020-09-211h 17Everything Hertz
Everything Hertz115: A modest proposalWe discuss James' recent proposal that scientists should be paid for performing peer review for journals published by for-profit companies—$450, to be precise. Dan also puts forward three meta-science projects that he thinks are worth funding. More details James' tweet proposing peer review should be compensated Since recording this episode, James has set up the @450Movement twitter account Also see James' blog post The Collabra Psychology journal Did the folks that co-authored the "redefine statistical sigificance" paper actually go on to follow their own recommendations? Would high financial compensation of people on job search panels lead to...
2020-09-071h 00Everything Hertz
Everything Hertz114: Diversity in science (with Jess Wade)We chat with Jess Wade (Imperial College London) about diversity issues in science, including her work increasing the profile of underrepresented scientists on Wikipedia and on getting more young women into science. Here's what we cover: Jess' Wikipedia page Inferior, by Angela Saini What's involved when making a bio page? The "notability" criteria for adding a scientist's bio on wikipedia Listen to Wikipedia grow on Hatnote Don't write your own page, even under a psuedonym. What's the best way to get girls into science and engineering? The lack of diversity in science award winners Follow Jess...
2020-08-1753 minEverything Hertz
Everything Hertz113: Citation neededDan and James discuss whether scientists should spend more time creating and editing Wikipedia articles. They also chat about how they read scientific articles and the heuristics they use to help decide whether a paper's worth their time. Here are some more details and links: Send in your audio questions here How does James read so much and what tips do Dan and James have for reading papers? The Stork paper recommendation service How James and Dan rapidly judge whether a paper is worth the time to read The benefit of a memorable paper title Peer...
2020-08-0353 minEverything Hertz
Everything Hertz112: Leaving academiaDan and James chat about James' new industry job, why he quit academia, the biggest differences between academia and industry, and why it's crucial for early career researchers to have a plan B. James new industry job James' medium blog post Having a plan B (and plan C) in academia Using consulting a bridge to a full-time industry job How to get an industry job The role of grant success in academia More research is now open access than not Get 20% off our merch by using the promo code "AUGUST" It's now easier to not be employed in...
2020-07-2751 minEverything Hertz
Everything Hertz111: The cumulative advantage of academic capital (with Chris Jackson)We chat with Chris Jackson (Imperial College, London) about the "Matthew Effect" in academia, how we can improve work/balance, and whether we should stop citing shitty people. Here's more stuff we cover: Chris climbed the world's most dangerous volcano for a BBC show Chris' email signature Having a code of conduct for your lab Work/life balance in academia Are things worse in academia compared to other desk jobs? How Chris co-founded "EarthArxiv", a preprint server for the earth sciences The point/counterpoint article format (here is an example) Open science in the geosciences Requesting...
2020-07-061h 00Everything Hertz
Everything Hertz110: Red flags for errors in papersWe answer a listener question on identifying red flags for errors in papers. Is there a way to better equip peer-reviewers for spotting errors and suspicious data? More details and links... We answer an audio question from Kim Mitchell. Submit your audio questions via our website Nick Brown's blogpost on the video game "study" We ran a live survey using Prolific! Go to prolific.com/everythinghertz to get $50 worth of credit for $1 Spotting unlikely data in meta-analysis How can make reviewers better at detecting errors in papers? Using a "Red team" to pull apart your papers ...
2020-06-1546 minEverything Hertz
Everything Hertz109: Open scientific publishing [Live episode]Dan and James recorded a live episode on open publishing as part of the Open Publishing Fest. They also ran a survey (from start to finish) during the course of the episode on the public's perception of open scientific publishing and discuss the results. Here are more stuff they covered, plus links! The Open Publishing Fest We collected data LIVE thanks to Prolific! Go to prolific.co/everythinghertz to get $50 worth of credit for just $1 How to build a low cost book scanner A prepreprint repository for African researchers What is the role of "niche" preprint...
2020-06-0151 minEverything Hertz
Everything Hertz108: Requiem for a ScreenWe discuss the recent claim that screen time is more harmful than heroin and whether psychological science is a crisis-ready discipline Other stuff we cover: Dan's adjustment to a second kid The "Psychological science is not yet a crisis ready discipline" preprint The Twitter thread from Rickard Carlsson There is a contimuum of evidence for psychological science's use in a crisis Belgian Officials: To Save Country's Potato Industry, Belgians Must Eat More Fries Our episode with Amy Orben Screen time has apparenty worse effects than heroin use on wellbeing Are we better off without press releases?
2020-05-1847 minEverything Hertz
Everything Hertz107: Memes, TikTok, and science communication (with Chelsea Parlett-Pelleriti)We chat with Chelsea Parlett-Pelleriti (Chapman University, USA) about the role of memes and emerging social media in communicating science and statistics. Stuff we cover + links: Why Chelsea uses memes and social media for science communication Chelsea's use of TikTok Chelsea's TikTok profile Chelsea's Instagram profile How much time should you spend on science communication vs. science research? What Twitch is and how this can be used by academics Chelsea's Twitch profile Dan's livestream of him writing a paper Chelsea's profile on YouTube Custom Stats themed Quiplash Game Codes: (JNL-HWDN) (DJM-ZDES) Is Instagram worth it for...
2020-05-041h 05Everything Hertz
Everything Hertz106: Science on the runDan and James discuss whether getting rapid outcomes to address the pandemic is worth the increased risk of mistakes—how can researchers perform research that is both urgent and accurate? Here's other stuff they discuss... Whiskey as a hobby James' pandemic tips How publication practices have changed during the pandemic The news article that stated bioRxiv papers are peer-reviewed Peer review during a pandemic The impact of the corona virus on employment in academia Bad peer-reviewed studies do more damage than bad preprints Preprints that require permission for citation Is there a need for the rapid di...
2020-04-2050 minEverything Hertz
Everything Hertz105: Tell it like it is (with Marike Schiffer)We chat with Marike Schiffer, who is a Senior Editor at Nature Human Behavior, about her journal's push to increase reproducibility in the behavioral sciences. She also shares how her team evaluates manuscripts and some common misunderstandings about scientific publishing. Here's what else we cover: Marike's experiencing making the switch from researcher to full-time editorial work The day-to-day tasks of an editor The Manifesto for reproducible science Why has Nature Human Behavior made such a big push towards reproducibility The benefits of transparent peer review comments The importance of posting rich datasets Transparency in how journals...
2020-04-0657 minEverything Hertz
Everything Hertz104: Now we'll discover which meetings could've been emailsDan and James discuss the COVID-19 pandemic and how it's impacting academia Other things they discuss: Roy and HG's gymnastics commentary from the Sydney 2000 olympics News tickers and collective anxiety How will cancelled talks and events influence our careers? Use the promo code "everythinghertz" to get $50 in free Prolific credit that you can use to recruit online participants for your next study, more details here Using ‘Second Life’ for conferences Tools for working from home "It’s just a cough" skit Other links [Dan on twitter](www.twitter.com/dsquintana) [James on twitter](www.twitte...
2020-03-161h 03Everything Hertz
Everything Hertz103: Swiping rightDan and James discuss rejection in academia and emerging science communication mediums. Here are a few links and other things they cover: The main university of Sydney bar has closed because all the youth are playing Fortnite and on TikTok How should you respond to rejection? The rejected paper on fasting during Ramadan and cognitive control What if there was Tinder for manuscript submission? Josh’s tweet about citations in Wikipedia Grant lotteries The Steven Bradbury reference The use of TikTok for science communication Dan and James argues about whether blogs or twitter threads are better Disney pr...
2020-03-021h 17Everything Hertz
Everything Hertz102: Master of noneShould research scientists build their knowledge and skillset broadly at the risk of being a master of none? Dan and James discuss this, along with a recent editorial on the use of Twitter in academia. Here's other stuff they cover: Some tools that Dan's using right now: BioRender, Canva, Slack, 99designs, and Notion. Dan pre-registers a prediction Herchandise! Use the code "EH102" to get a 20% discount on Hertz merchandise (valid until March 2, 2020) The k-index editorial Roger Ebert's statue James wanted a picture of this fish in the show notes, for some reason Other links ...
2020-02-171h 04Everything Hertz
Everything Hertz101: Punishing research misconductDan and James cover a new paper which discusses whether research misconduct should be criminalised. If so, where do we draw the line and who should investigate these cases? Here's an episode overview and links to stuff we mentioned: We’re a pop science podcast, apparently Elizabeth Bik’s wikipedia page Elizabeth’s Patreon page The original consortium letter The apology letter from the APS The “love of science” tweet How James got into science Tal’s “science is not a jobs program” tweet The 'Should research misconduct be criminalised?' article Professor charged with spending $96k in...
2020-02-0359 minEverything Hertz
Everything Hertz99: Science advocacyDan and James answer a listener question on science advocacy. Is this an activity that all scientists should do, and if so, how much advocacy work should we be doing? Here's other stuff they cover and links to stuff they mention: James’ thoughts on thanksgiving James’s hot mic tweet The Tom Bartlett story in the Chronicle about the criminologist accused of cooking the books The SCORE DAPRA project A listener question from Crystal Steltenpohl: What is a scientist’s role in advocacy? Julieanne Smolinski piece on Hollywood diets Sunbathe your arsehole, for wellness Dealing with bad sc...
2020-01-0649 minEverything Hertz
Everything Hertz98: Episode titles are redundant, at best (with Sophia Crüwell)We chat with Sophia Crüwell (Meta-Research Innovation Center Berlin) about pre-registration and her recent work introducing pre-registration templates for cognitive modelling research. Here's what we cover and some links: Sophia’s PhD research Sophia’s recent preprint: Preregistration in Complex Contexts: A Preregistration Template for the Application of Cognitive Models The first version of the pre-print titled, preregistration is redundant, at best The updated version of the preprint titled, "Is preregistration worthwhile?" The Bayesian Spectacles blogpost on the first version of the pre-print Data simulation from former guest Lisa DeBruine The latest with reproducibilitea The cargo...
2019-12-1659 minEverything Hertz
Everything Hertz97: Slow scienceDan and James discuss the concept of "slow science", which has been proposed in order to improve the quality of scientific research and create a more sustainable work environment. Here's what they cover in this episode Thank you patrons day! Social media algorithms reward outrage, not quality of substance A paper on slow science from Uta Frith, which includes a proposal of publication limits Is information overload really a problem? The META platform for a weekly research digest Would reducing the volume of publications really improve quality? The working paper that simulated the quality vs. quantity...
2019-12-021h 00Everything Hertz
Everything Hertz96: The chaotic state of doctoral researchDan and James discuss the results of this year's Nature survey of PhD students. Despite a majority of students reporting general satisfaction with their decision to undertake a PhD, many described a sense of uncertainty, harassment in the lab, and gruelling work hours. Things they discuss... James met an Australian member of parliament and won a commendation from Sense under Science The Doing Good symposium The Nature PhD survey Bloat in academia What people like the most about being a PhD student Are we just not hearing that much from people who are having a good...
2019-11-1847 minEverything Hertz
Everything Hertz94: Predicting the replicability of researchDan and James chat with Fiona Fidler (University of Melbourne), who is leading the repliCATS project, which aims to develop accurate techniques to elicit estimates of the replicability of research. This is also the first time they interview a guest live! Here's what they discuss... The story behind repliCATS Australia's best export, Tim Tams The SCORE project organised by DARPA Can anyone use the repliCATS methodology? Dan, Fiona, and James talk about did their honours theses (this is roughly the Australian equivalent of a Masters) What would a successful repliCATS project look like? What sort of...
2019-10-2158 minEverything Hertz
Everything Hertz93: Double-blind peer review vs. open scienceDan and James answer a listener question on how to navigate open science practices, such as preprints and open code repositories, in light of double-blind reviews. Stuff they cover: How common is double-blind review? How many journals don’t accept preprints? Bias in the review process How practical is blinded review? Do the benefits of preprints outweighs not having blinded review? James' approach to getting comments on his preprints Convincing your supervisor to adopt open science practices The preprint that James won’t submit for publication, for some reason We get reviews... Our first live guest! Ot...
2019-10-0754 minEverything Hertz
Everything Hertz92: Chaos in the brickyardDan and James discuss the role of Google Scholar in citation patterns and whether we should limit academics to only publishing two papers a year. Links and details: James has a new Hertz-quarters The Metascience conference How is google scholar influencing citation patterns A slide from @Jevinwest's presentation on Google Scholars Is this a symptom of lazy citaton practices rather than the algorithm? What are the alternatives to google scholar? Should google open up the algorithm? GS will find your preprint and link it to the paywall link Why is Google Scholar free? What would make...
2019-09-161h 13Everything Hertz
Everything Hertz91: Shifting the goalposts in statistics (with Kristin Sainani)We chat with Kristin Sainani (Stanford University) about a popular statistical method in sports medicine research (magnitude based inference), which has been banned by some journals, but continues to thrive in some pockets of scholarship. We also discuss the role of statistical inference in the current replication crisis. Links and info What is magnitude based inference and how did Kristin get involved in this? The response to Kristin’s critiques This is really an issue of small sample sizes Kristin’s Coursera course on scientific writing The readability of scientific articles is decreasing The role of stat...
2019-09-021h 03Everything Hertz
Everything Hertz90: Mo data mo problemsDan and James discuss two listener questions on performing secondary data analysis and the potential for prestige to creep into open science reforms. More info and links: Why generate your own dataset when you can get a high impact paper using public data? Thanks to Stu Murray for the question Will people steal your ideas? The journal Scientific Data Are we now incentivising data mining rather than data collecting? Synthetic data Dan’s recent synthetic data preprint primer Ego and prestige got us into the mess we’re trying to fix with open science, but how can...
2019-08-1958 minEverything Hertz
Everything Hertz89: Conflicts of interest in psychology (with Tom Chivers)We chat with Tom about whether psychology has a conflict-of-interest problem and how to best define such conflicts. Links and other stuff we cover... Tom's article on conflicts of interest in psychology How can we define a conflict an interest without falling down a rabbit hole? Communication statistics to the layperson How science journalism focuses on single studies rather than the larger story Tom’s new book: The AI does not hate you Win Tom’s book! Tweet your favourite Hertz episode and we’ll pick one at random, who'll get sent Tom's book How do journa...
2019-08-0559 minEverything Hertz
Everything Hertz88: The pomodoro episodeDan and James apply the pomodoro principle by tackling four topics within a strict ten-minute time limit each: James' new error detection tool, academic dress codes, the "back in my day..." defence for QRPs, and p-slacking. Here are links and details... James won an award James’ new error detection tool, DEBIT Academic dress codes P-slacking The p-slacking paper Marcus Crede’s paper: A Negative Effect of a Contractive Pose Is Not Evidence for the Positive Effect of an Expansive Pose A preview of our next episode on conflicts of interest in psychology Other links [Dan...
2019-07-151h 00Everything Hertz
Everything Hertz87: Improving the scientific poster (with Mike Morrison)We chat with Mike Morrison, a former User Experience (UX) designer who quit his tech career to research how we can bring UX design principles to science. We discuss Mike's recently introduced 'better poster' format and why scientists should think carefully about UX. Here's what we cover: What’s the story behind the “better poster?” The Better Poster video The Better Poster template The importance of minimising cognitive load Science isn’t badly designed, it’s not even designed at all What is good User Experience (UX)? The most important feature of SciHub Version 2 of the ‘better poste...
2019-07-0151 minEverything Hertz
Everything Hertz86: Should I stay or should I go?Dan and James answer a listener question on whether they should stick it out for a few months in a toxic lab to get one more paper or if they should leave. Other stuff they cover: We don’t like cricket, oh no, we love it James is bad at tribalism We answer a listener question about a bad lab environment The “Dutch Bounce” The Golden Lab Child Demonstrating independence by writing a sole author paper What should you do if there’s a late authorship switch on your paper? Having an upfront conversation about authorship James on...
2019-06-171h 04Everything Hertz
Everything Hertz85: GWAS big teeth you have, grandmother (with Kevin Mitchell)We chat with Kevin Mitchell (Trinity College Dublin) about what the field of psychology can learn from genetics research, how our research theories tend to be constrained by our research tools, and his new book, "Innate". Other stuff we cover: Kevin's book, "Innate: How the Wiring of Our Brains Shapes Who We Are" The story with link between Serotonin transporter gene 5-HTTLPR variation and it’s link to depression Gene wide association studies (GWAS) vs. candidate gene studies Correcting for multiple tests in GWAS What can psychology learn from genetics when it comes to improving methods? Wh...
2019-06-031h 23Everything Hertz
Everything Hertz84: A GPS in the Garden of Forking Paths (with Amy Orben)We chat with Amy Orben, who applies "multiverse" methodology to combat and expose analytical flexibility in her research area of the impact of digital technologies on psychological wellbeing. We also discuss ReproducibiliTea, an early career researcher-led journal club initiative she co-founded, which helps young researchers create local open science groups. Here are some more details and links: The tweet pointing our Dan's gramatical error in his usual introduction. THANKS DENIS Is Twitter melting our brains? The history of "new technology" panic What's the next panic? Moral entrepreneurs: profiting from moral panic Specification curve analysis: a way...
2019-05-2152 minEverything Hertz
Everything Hertz83: Back to our dirty unwashed rootsBy popular demand, Dan and James are kicking it old school and just shooting the breeze. They cover whether scientists should be on Twitter, if Fortnite is ruining our youth, book recommendations, and null oxytocin studies. Stuff they cover and links to obsure references Should scientists be on twitter? James runs a Twitter experiment Scite has now gone live, listen to our episode on this platform Our dreams of a live Hertz episode Is Fortnite killing our youth and the parallels with the “heavy metal” scare Amy Orben’s screen time study Multiverse analysis Book recomm...
2019-05-0859 minEverything Hertz
Everything Hertz82: More janitors and fewer architectsWe answer a listener question on the possible negative consequences of the open science movement—are things moving too quickly? Links and things we discuss in the episode: We have a new logo, if you haven't already noticed... Contact us via our website form! Considering the potential downsides of open science Here come dat boi meme explination The dangers of open access by fiat The role of commercial entities in open science The “University of Oslo fancy Norway people-pay-taxes oil money bloody library” Dropping the success rate of grants to increase the quality of evaluation Reframing open s...
2019-04-151h 11Everything Hertz
Everything Hertz81: Too Young To Know, Too Old To CareWe answer our first audio question, on whether academia is too broken to fix, and a second question on whether we’ve ever worried about the possible repercussions of our public critiques and commentary on academia. Show details: Our first audio question is from Erin Williams (@DrErinWill), who asks whether academia is too broken to fix The letter to the editor that got rejected, despite the publication of the response to the letter Harassment in academia Have we ever been worried that someone might say, "I'd never hire those dudes" because of what we say? Other st...
2019-04-0156 minEverything Hertz
Everything Hertz80: Cites are not endorsements (with Sean Rife)We chat with Sean Rife, who the co-founder of scite.ai, a start-up that combines natural language processing with a network of experts to evaluate the veracity of scientific work. Here's what we cover and links for a few things we mention What is scite.ai? The Winnower Why is there no good (and free) plagiarism detector? Grobid - A machine learning library for extracting, parsing and re-structuring PDFs Meta-analysis can prop up flawed bodies of literature The "Too meta" XKCD cartoon What’s the end game for scite? The 80,000 hours game Spooner, a utility that al...
2019-03-1751 minEverything Hertz
Everything Hertz79: Clinical trial reporting (with Henry Drysdale)We chat with Henry Drysdale (University of Oxford), co-founder of the COMPare trials project, which compared clinical trial registrations with reported outcomes in five top medical journals and qualitatively analysed the responses to critical correspondence. Discussion points and links galore: The history behind the COMPare project The two papers that were published: a prospective cohort study correcting and monitoring 58 misreported trials and a qualitative analysis of researchers’ responses to critical correspondence Ben Goldacre's books What is outcome switching? What were some of the responses to query letters from the authors and journals? Misreporting trials (usually) doesn't le...
2019-03-0355 minEverything Hertz
Everything Hertz77: Promiscuous expertiseDan and James discuss how to deal with the problem of scientists who start talking about topics outside their area of expertise. They also discuss what they would do differently if they would do their PhDs again Here's what they cover... The podcast will now be permanently archived on Open Science Framework James did a talk at the Sound Education conference on podcasting for early career researchers. Here's the video if you want to see him squirm uncomfortably in his chair for 20 minutes and/or hear his thoughts our approach to podcasting The temptation for academics...
2019-02-0455 min