Alexa Tullett - Podcast Details

Shows

Two Psychologists Four BeersRE-RELEASE: Destigmatizing Mental Health (with Andrew Devendorf)Andrew Devendorf joins Alexa and Yoel to discuss his work on "me-search" (or self-relevant research) within clinical psychology. He talks about the prevalence of mental health difficulties within the field, and the harmful taboos against speaking openly about them. And, he shares his own reasons for studying depression and suicide, and how he has been discouraged from citing personal experience as a motivation for his work. Their conversation also explores common misconceptions about mental illness, strengths of self-relevant research, and ways to be more supportive to those facing mental health challenges. In the end, Yoel and Alexa fail to...2023-10-041h 21

Two Psychologists Four BeersRE-RELEASE: We Need to Talk About FraudYoel and Alexa are joined by Joe Simmons to talk about fraud. We go in-depth on a recent high-profile fraud case, but we also talk about scientific fraud more generally: how common is it, how do you detect it, and what can we do to prevent it? This is a re-release of Episode 73, originally released on September 29, 2021.Special Guest: Joe Simmons.Links:Beers - DravMilkshake IPA - Microbrasserie Vox Populi - UntappdA-OK IPA - Avondale Brewing Co. - UntappdL'Espace Public – Brasseurs de quartier » L’attaque galactiqueFalse-Positive Psychology: Undisclosed Flexibility in Data Collection and A...2023-09-201h 23

Two Psychologists Four BeersAgainst Anti-DEI RhetoricJennifer Gutsell joins Alexa to discuss the controversy surrounding Yoel's experience interviewing at UCLA. They focus on a post, written by Alexa, in which she pushes back against defenses of "viewpoint diversity" and argues that the graduate petition advocating for diversity, equity, and inclusion (DEI) was a brave effort that should be taken seriously. Jennifer elaborates on these ideas, suggesting that there are some views that are not up for debate, and emphasizing the care that is required when having theoretical discussions without a personal stake in the matter. Alexa and Jennifer go on to connect these ideas to...2023-08-301h 07

Two Psychologists Four BeersWe Need to Talk About Fraud AgainHarkening back to episode 73, Alexa and Yoel discuss recent evidence of fraud documented in the Data Colada blog post "Clusterfake." The post is the first in a series of four, which will collectively detail evidence of fraud in four papers co-authored by Harvard Business School Professor Francesca Gino. First, the co-hosts dive into the details, with Alexa soberly (in both senses of the word) explaining the revelations of calcChain. They go on to discuss the potential impact of these findings for collaborators, some of whom have begun conducting audits of work co-authored with Gino. In addition, they speculate about...2023-06-231h 08

Two Psychologists Four BeersPatchwork PoliticsIn heated political debates, people are often accused of being hypocrites, lacking consistent foundational values. Today, Yoel and Alexa discuss a recent paper by David Pinsof, David Sears, and Martie Haselton, that challenges the commonsense notion that political belief systems stem from our core values. Instead, the authors propose that people form alliances with others, and develop political beliefs that serve to maintain those alliances. The cohosts discuss how these alliances might form, the various biases used to defend them, and whether values are truly absent from the process. They also tackle the deeper question of whether the alliance...2023-05-1758 min

Two Psychologists Four BeersQuantifying the Narrative of Replicable ScienceYoel and Alexa discuss a recent paper that takes a machine learning approach to estimating the replicability of psychology as a discipline. The researchers' investigation begins with a training process, in which an artificial intelligence model identifies ways that textual descriptions differ for studies that pass versus fail manual replication tests. This model is then applied to a set of 14,126 papers published in six well-known psychology journals over the past 20 years, picking up on the textual markers that it now recognizes as signals of replicable findings. In a mysterious twist, these markers remain hidden in the black box of...2023-03-291h 09

Two Psychologists Four BeersPsych (with Paul Bloom)Alexa and Yoel chat with Paul Bloom about his newest book, Psych: The Story of the Human Mind. The book, built from Paul's popular Introduction to Psychology course, is an opinionated overview of the field of psychology but also a window into his deep fascination with the mind. Yoel and Alexa spend some time picking Paul's brain, inquiring about writing, and teaching, and how to avoid boredom. But Paul has a few questions of his own, challenging the cohosts to consider what their own version of Psych would look like. In the process, their conversation ranges from Freudian dream...2023-03-081h 09

Two Psychologists Four BeersDestigmatizing Mental Health (with Andrew Devendorf)Andrew Devendorf joins Alexa and Yoel to discuss his work on "me-search" (or self-relevant research) within clinical psychology. He talks about the prevalence of mental health difficulties within the field, and the harmful taboos against speaking openly about them. And, he shares his own reasons for studying depression and suicide, and how he has been discouraged from citing personal experience as a motivation for his work. Their conversation also explores common misconceptions about mental illness, strengths of self-relevant research, and ways to be more supportive to those facing mental health challenges. In the end, Yoel and Alexa fail to...2023-02-081h 19

Two Psychologists Four BeersAn Outside Perspective on Implicit BiasAlexa and Yoel discuss the much trodden topic of implicit bias from a less trodden perspective: that of the general public. Offering insight into the public's views is a paper by Jeffrey Yen, Kevin Durrheim, and Romin Tafarodi, which explores public thinking about the implicit association test (IAT) through an examination of the New York Times comments section. These comments demonstrate varying reactions to the idea that negative associations with some identities - racial and otherwise - can bubble beneath the surface of our explicit attitudes. Some dismiss the IAT as "academic abstraction," while others see their scores as...2023-01-181h 15

Two Psychologists Four BeersIs MTurk Too Good To Be True?In a recent article, psychologists Webb and Tangney document their experience collecting psychology data online using Amazon's crowdsourcing platform MTurk. Alarmingly, the authors conclude that ultimately only 2.6% of their sample was valid data from human beings. Yoel and Alexa weigh in on these findings, discussing what researchers can reasonably expect from online studies and platforms, and how their personal experiences have informed their own practices. They also consider a response written by Cuskley and Sulik, who argue that researchers, not recruitment platforms, are responsible for ensuring the quality of data collected online. Questions that arise include: What studies do...2022-12-071h 03

Two Psychologists Four BeersInspired Science (with Spencer Greenberg)Yoel and Alexa are joined by Spencer Greenberg, founder of the behavioral science startup incubator Spark Wave and host of the Clearer Thinking podcast. He describes how he became fascinated with psychology and behavior change, and how he's been working to provide empirically-backed strategies for everday tasks, like making decisions or forming habits. He also offers an alternative perspective on open science, arguing that a phenomenon he calls "importance hacking" has been overshadowed by p-hacking in calls for science reform. Greenberg further challenges the Alexa and Yoel to consider whether the "open scientist" will fall short of what can...2022-11-231h 10

Two Psychologists Four BeersGetting Into Grad SchoolWith grad school application deadlines around the corner, Alexa and Yoel discuss how, exactly, that process works. Big picture, they talk about their goals in selecting graduate students to work on their labs, and whether they've gotten good at the process. They also examine typical application requirements - including recommendation letters, personal statements, GPAs, and (sometimes) the GRE - and consider which they'd keep, and which they'd prefer to never deal with again.Links:Two Psychologists F. on UntappdMastodon - Decentralized social mediaMastodon - WikipediaTwo Psychologists Four Beers Episode 32: Measurement Schmeasurement (with Jessica Flake)A wave...2022-11-0957 min

Two Psychologists Four BeersSo, What Do You Do?Yoel and Alexa discuss a recent paper, written by Hughes, Srivastava, Leszko, and Condon, that created and validated a new index of "occupational prestige." The index is intended to provide a tool to measure the third component of socioeconomic status, alongside income and education. The cohosts consider how occupational prestige might lead to differential treatment, or even unrealistic expectations ("is anyone in this hotel a doctor?"). Digging deeper, they discuss the paper's exploration of ways that prestige tracks with the physical, critical thinking, and interpersonal demands of a profession. Finally, they realize that as a "former social neuroscientist," Alexa...2022-10-261h 12

Two Psychologists Four BeersWhat are Teachers Good For? (with Paul Bloom)Paul Bloom joins Yoel and Alexa to talk about the glamour and humiliation of teaching psychology at the college level. They discuss how they've changed their approaches to teaching over the years, and whether they've become more skilled or more out of touch (or both). Alexa shares her experiences teaching about morality and evolution to a predominantly Christian student body, Yoel laments the fact that his students aren't more disagreeable, and Paul claims that critical thinking is overrated. In an era of increasing remote instruction, they claim that online courses can't do what they do. But, only Yik Yak...2022-09-281h 07

Two Psychologists Four BeersIndividualism, Interdependence, and Student LoansInspired by a recent Atlantic article ("The Myth of Independent American Families" by Stephanie H. Murray) Alexa and Yoel consider what it means to live in an indiviualistic society. At an abstract level, they discuss different visions for interdependence, from communes to church communities to welfare states. On a more personal note, they reflect on ways that they depend on, and support, people in their families and communities, and whether it would be desirable to increase those levels of reliance. They also consider the domains of romantic relationships (should we feel like we're free to leave at any time...2022-09-1459 min

Two Psychologists Four BeersFacing a Social Media Mob (with Stefan Uddenberg)Yoel and Alexa are joined by Stefan Uddenberg, a social perception researcher and author of the paper "Deep Models of Superficial Face Judgments." This paper was the focus of a previous episde - "A Face for Podcasting" - in which the co-hosts discussed the research, and the resulting controversy. Now, Stefan offers a new, insider perspective. He begins by offering a deeper explanation of the work, noting that a large, diverse set of facial images, is essential for studying how people are unfairly judged based on appearance (e.g., their race and gender). He also recounts the outrage on...2022-08-241h 14

Two Psychologists Four BeersShould SPSP Stay Out of It?As the Society for Personality and Social Psychology (SPSP) starts gearing up for their 2023 conference, Alexa and Yoel debate some of the organization's recent efforts to be more anti-racist and politically engaged. First, the co-hosts discuss debate over moving the conference from its originally scheduled location (Atlanta, Georgia) due to the state's restrictive abortion laws. They consider how boycotting (or, as SPSP ultimately decided, not boycotting) fits with the organization's mission and identity. Second, they examine SPSP's new submission evaluation criteria, which reward submissions for promoting equity, inclusion, and anti-racism. Yoel and Alexa are largely divided on both topics...2022-08-031h 13

Two Psychologists Four BeersDecriminalizing Mental IllnessYoel and Alexa chat with Jennifer Cox and Lauren Kois, co-directors of the Southern Behavioral Health and Law Initiative. Established in 2020, the initiative was created to address the dearth of mental health resources for people who become involved with the legal system. Jennifer and Lauren walk our co-hosts through common scenarios that can occur when a person with mental illness encounters the legal system, some of which involve long waits in understaffed state hospitals with little access to basic mental health resources. They also describe various efforts to ameliorate these problems, including their own work to optimize use of...2022-07-201h 21

Two Psychologists Four BeersFreelance Kinkology (with Aella)Independent researcher Aella joins Yoel and Alexa to talk about her experiences doing freelance social science. Their discussion touches on some far-ranging topics, from the upsides of Twitter microfame to the humbling experience of questioning one's faith. At one point, they consider the compromises - good and bad - that come from catering to one's critics. Aella also discusses a recent funded research project where she asks people about their sexual fetishes. Special Guest: Aella.Links:Two Psychologists F. on UntappdKnowingless – In pursuit of an internally consistent annihilationerodynamicsAll The Twitter Polls (@aella_girl) - Go...2022-07-061h 26

Two Psychologists Four BeersWhat's Wrong with Social Media?Mickey returns with the hot takes you know and love. He joins Yoel and Alexa to discuss Jonathan Haidt's recent Atlantic article, "Why the Past 10 Years of American Life Have Been Uniquely Stupid." Haidt claims the answer is social media, but the cohosts aren't fully convinced. To shed a bit more light on the matter, they turn to an article by Amy Orben and Andrew Przybylski which provides a rigorous analysis of the relationship between social media use and well-being. In the end, Mickey admits to being a hypocrite, and Alexa makes a plug for Big Potato. ...2022-06-221h 23

Two Psychologists Four BeersMany Many LabsEarlier this year, the last of five "Many Labs" projects was accepted for publication at Collabra: Psychology, representating the culmination of a nearly-decade long series of multi-lab replication efforts. In this episode, Alexa and Yoel consider what they've learned from Many Labs 1 through 5, including insights about replication, expertise, and the impact (or lack thereof) of small effects. They also discuss their own connections to the project - Yoel as an original author, and Alexa as a researcher examing psychologists' reactions to the findings. Although the co-hosts deny they have any existential fear of death (see Many Labs 4) they do...2022-06-081h 14

Two Psychologists Four BeersThe Distracting Nature of NudgesOriginating within the behavioral sciences, "nudging" has received attention as a way to achieve broad societal change by promoting small, individual adjustments. We're told, for instance, that if we all do our part reduce our carbon footprints we can stave off climate change. In today's episode, Yoel and Alexa consider a critique of "nudging" offered by Chater and Loewenstein. These authors argue that individual-level interventions often fail to accumulate to impressive societal change, and meanwhile distract from much needed system-level solutions. Also, Yoel claims to be less relatable than Alexa.Sponsored By:FindingFive: Link and promo...2022-05-181h 11

Two Psychologists Four BeersA Face For PodcastingYoel and Alexa discuss a recent study that examines the facial features that people perceive as "smart," "dorky," "trustworthy," or a number of other traits. The study quickly captured a lot of attention, eliciting both fascination and anger. The cohosts turn to Twitter, and to Alexa's undergraduate students, to attempt to gain a deeper understanding of the criticisms and suspicions expressed about the work. In the process, they consider whether glasses make you look smart, and whether babies can be trusted.Sponsored By:FindingFive: Link and promo code for users in the European Union Promo Code...2022-05-011h 05

Two Psychologists Four BeersPeople Dealing With the Pandemic Pretty Well, Study FindsOriginally, Yoel and Alexa set out to discuss a study examining stress and decision-making during the pandemic. However, they get sidetracked by the ways that data are packaged - first by APA, and then by NPR - into a newsworthy account that may not tell the whole story. They identify ways in which the summary statements and headlines may exaggerate or twist the data into a more interesting narrative. Despite their skepticism, they consider NPR's advice about how to improve day-to-day decision-making. In a particularly humble moment, Yoel concedes that he should have known better than to buy a...2022-04-201h 07

Two Psychologists Four BeersCheck Your Values?Alexa and Yoel fight some more, this time over whether or not science should be value free. They consider a position taken by W. E. B. Du Bois, who argued that social change was only possible if scientists focused solely on finding truth. In the process, they consider whether scientists should ever keep findings to themselves, and discuss the merits of leaving the value judgments to the politicians. In the end, they somehow conclude that it is fine that they never justify their alphas. Next time, Alexa promises to find out what's happening on UA frat house lawns.2022-04-061h 08

Two Psychologists Four BeersGrand ChallengesYoel and Alexa discuss the "grand challenges" of psychological science, as identified in a recent survey of APS members. While usually nauseatingly agreeable, the two find many points of contention when it comes to psychology's shortcomings - from the kinds of diversity worth wanting to the value of decolonizing your syllabus. In the end, they make amends by agreeing that psychological science is, unfortunately, unlikely to solve climate change. And, along the way they express their appreciation for winter sports, tax advice, and alcoholic seltzers without artificial sweeteners.Sponsored By:FindingFive: Link and promo code for...2022-03-231h 15

Two Psychologists Four BeersPsychology Worth KnowingYoel and Alexa embrace their credulous sides and consider concepts from psychology that have importance for people in their private and public lives. Each of us lists the three social psychological ideas that we think are most relevant to people's lives - the kinds of things we would teach if we could give just one lecture. There are areas of consensus, but at some point Alexa wonders what Yoel has against insurance. We also discuss our inability to meaningfully discuss international politics.Sponsored By:FindingFive: Link and promo code for users in the European Union Promo...2022-03-091h 15

Two Psychologists Four BeersAgainst RetributionAlexa moonlights as a guest and answers Yoel's questions about her recent paper, in which she argues that the criminal justice system should abandon retribution. Alexa claims that when we ask if someone is blameworthy, we are asking social scientific questions: Were they rational? Were they being coerced? Were they acting out of character? We discuss some aspects of the social scientific evidence - from vignettes about soaping windows to group-to-individual inference - and consider whether it can provide satisfying answers. And, Yoel challenges Alexa to consider whether her utopian vision might have unintended consequences. Plus, we...2022-02-231h 10

Two Psychologists Four BeersAll About AuthenticityAlexa and Yoel talk authenticity. What is it? Is it good to have it? And why does Alexa score higher on it than Yoel? We talk about a draft paper examining how people infer authenticity in themselves and others, and a recently-published paper suggesting that supposedly highly authentic people might just be motivated to present themselves that way. Plus, Alexa drinks some listener-supplied beer, with favorable results, and we discuss who the most famous academic is.Links:Two Psychologists Four Beers on UntappdJordan Peterson: Why I am no longer a tenured professor at the...2022-01-261h 21

Two Psychologists Four BeersMeehl on TheoryAlexa and Yoel are back with more amateur philosophy of science. This time, we do a deep dive into a paper by the legendary Paul Meehl: "Appraising and Amending Theories: The Strategy of Lakatosian Defense and Two Principles that Warrant It." What can this classic paper tell us about how to do better research? We also talk about lactose, tandem bicycles, and New Year's resolutions (not in that order).Links:Two Psychologists Four Beers on UntappdAppraising and Amending Theories: The Strategy of Lakatosian Defense and Two Principles that Warrant It: Psychological Inquiry: Vol 1, No 2...2022-01-121h 08

Two Psychologists Four BeersAgainst Method?Alexa and Yoel tackle Paul Feyerabend, the wild man of philosophy of science. What can we learn from his "anything goes" argument for methodological anarchy? We go deep on the first five chapters of Feyerabend's most famous work, "Against Method," and discuss his (maybe not entirely serious) arguments for extreme theory proliferation, ignoring the data, and Chinese herbal medicine. Also, we discuss which Christmas album is superior: Sia or Dolly Parton.Links:Two Psychologists Four Beers on UntappdSia's Christmas AlbumDolly Parton's Christmas AlbumBaller Christmas TreeGreenwald's Paper on Theory Controversies 2021-12-081h 14

Two Psychologists Four BeersPreregistration (What is it Good For)Alexa and Yoel talk about objections to preregistration. Does preregistration imply that researchers can't be trusted? Does it mean that they can't use their best judgment? When might preregistration be unhelpful? We also discuss researcher degrees of freedom in a recent paper testing Cardi B's maxim that "hoes don't get cold." Plus: ketchup on ice cream, and Alexa's controversial replacement for Daylight Savings Time.Links:The political war around daylight saving time takes a nasty turn - POLITICOQuantitude S3E07: In Defense of Researcher Degrees of FreedomWhen looking 'hot' means not feeling cold: Evidence...2021-11-171h 07

Two Psychologists Four BeersBeyond ExperimentsAlexa and Yoel talk about a paper purporting to show that winning the Nobel Prize increases your lifespan. In the process, they dip their toes into non-experimental causal inference and discuss whether there is a taboo in psychology about drawing causal conclusions from non-experimental data. Plus, Yoel does his best to explain what an instrumental variable is and Alexa drinks a very large beer.Links:Two Psychologists Four Beers on UntappdThe Taboo Against Explicit Causal Inference in Nonexperimental Psychology - Michael P. Grosz, Julia M. Rohrer, Felix Thoemmes, 2020Instrumental Variables in Sociology and the Social Sciences...2021-11-031h 07

Two Psychologists Four BeersWe Need to Talk About Fraud (with Joe Simmons)Yoel and Alexa are joined by Joe Simmons to talk about fraud. We go in-depth on a recent high-profile fraud case, but we also talk about scientific fraud more generally: how common is it, how do you detect it, and what can we do to prevent it? Special Guest: Joe Simmons.Links:Drav India Session AleMilkshake IPA - Microbrasserie Vox PopuliA-OK IPA - Avondale Brewing Co.L'Espace Public - Neighborhood brewers »The galactic attackFalse-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant - Joseph P. Simmons, Leif D. Nelson, U...2021-09-291h 22

Two Psychologists Four BeersThe Good LifeAlexa and Yoel discuss a new paper (Oishi & Westgate, 2021) arguing that psychological richness is an overlooked aspect of the good life. In the process, they compare psychologically-rich-life scores, plan hypothetical vacations, and compare major regrets. Also, Alexa reviews an (accidentally-purchased) alcohol-free beer.Links:IPA du Nord-Est (beer) - Episode | Boréale | BoréaleLow Viz IPA | Arches Brewing | BeerAdvocateRun Wild IPA (Non-Alcoholic) 6-Pack | Athletic Brewing Company | Craft Non-Alcoholic BeerA psychologically rich life: Beyond happiness and meaning. - PsycNETJust think: The challenges of the disengaged mindDiederik Stapel's MemoirThe Kinks - Sunny Afternoon (Official Audio) - YouTube 2021-09-011h 06

Two Psychologists Four BeersOlderAlexa and Yoel tackle the most dreaded subject: getting older. Have they become better researchers and people over the years? Are they happier and more connected? Or are they just more forgetful and less good at stats? Plus: some listener feedback about self-care raises conceptual questions about suffering.2021-08-111h 04

Two Psychologists Four BeersHow to Self-CareAlexa and Yoel go deep on self-care. What is it, how do you do it, and why does the term raise Yoel's hackles? How hard do we actually work, and should we be trying to work less? Also, Alexa shares an amazingly successful culinary experiment.Links:The Least Stressful Jobs Of 2013How Hard Do Professors Actually Work? - The AtlanticResearch shows professors work long hours and spend much of day in meetingsHow I Practice Self-Care as a Black Woman in Academia | TimeAcademics should make time for self-care, even if just a few minutes each...2021-07-211h 11

Two Psychologists Four BeersHow (Not) to be a HaterAlexa and Yoel discuss "The Anticreativity Letters," a satirical article by Richard Nisbett that advises young psychology researchers to (among other things) avoid being overly critical. How does the article's advice hold up today? How does one combine appropriate skepticism with enthusiasm for research? Or are the two in conflict at all? Plus: Alexa gets salty about salty drinks, and Yoel returns to the gym.Sponsored By:Paperpile: No-fuss reference management for the web. Manage your research library, right in your browser. Promo Code: BEERSLinks:The Anticreativity LettersCitrus Sage | Cascade BrewingLueur...2021-07-071h 24

Two Psychologists Four BeersHow is Open Science Doing?Yoel and Alexa discuss progress in open science over the past 10 years. Is the scientific reform glass half-full or half-empty? Where have we made progress, and what still needs work? We use two papers describing "Scientific Utopia" by Nosek and colleagues (written nearly 10 years ago!) in order to evaluate our progress. Also, the true story of how Ashley Madison got its name.Sponsored By:Paperpile: No-fuss reference management for the web. Manage your research library, right in your browser. Promo Code: BEERSLinks:Unibroue | Megadeth Saison 13Just the Juice - Prairie Artisan...2021-06-091h 26

Two Psychologists Four BeersOur Social Media PrismsMickey, Alexa, and Yoel break down "Breaking the Social Media Prism," a new book arguing that social media reinforces our pre-existing political beliefs and polarizes us against the other side. Plus, HUGE NEWS about who's hosting the show. Also, Yoel gets a French lesson.Links:Saison - Sour beer – LOOP MissionLazer Lager | Brasserie Dieu du Ciel! | BeerAdvocateTrimTab IPA - TrimTab Brewing Co. - UntappdIPA - Wild Range Brewing Company - UntappdSustainability – HALF HOURS ON EARTHThe Future Is Electric - Half Hours on Earth - UntappdBreaking the Social Media Prism: How to Make Our Platforms Less...2021-05-261h 28

The Black GoatAn Award-Winning EpisodeAcademics love awards. We give out career awards, mid-career awards, early-career awards. We give out awards for the best paper, the best theory, the best teaching, the best service. But what function do all those awards serve? And are we the better for having them? In this episode we talk about how awards fit into the academic ecosystem. How do recipients benefit from them? How do they help the organizations and research communities that give them out? What kinds of biases are baked into the system, and how can we counteract them? Should we consider radically changing how academic...2020-09-091h 04

The Black GoatContact SportThe contact hypothesis is an old idea in social psychology. It posits that under the right circumstances, bringing people from different groups together can reduce prejudice. In this episode, we discuss a new field experiment by Salma Mousa testing whether putting Iraqi Christians and Muslims on soccer teams together can rebuild social cohesion after war. Part of our conversation focuses on the direct implications of this work for the contact hypothesis. We also discuss how this study stands out against some common patterns in social science research. Why, despite the long history of research and intuitive appeal of the...2020-08-261h 07

The Black GoatDoes Not ComputeScientific journal articles have a lot of numbers. Scientists are smart people with even smarter computers, so an outsider might think that, if nothing else, you can count on the math checking out. But modern data analysis is complicated, and computational reproducibility is far from guaranteed. In this episode, we discuss a recent set of articles published at the journal Cortex. A group of authors set out to replicate an influential 2010 article that claimed that if you reactivate a fear-laden memory, it becomes possible to change the emotional association - something with clear relevance to clinical practice. Along the...2020-08-131h 01

The Black GoatObjective UnknownHow does psychology's response to the replication crisis fit into a broader history of science? In this episode we discuss a paper by sociologists Jeremy Freese and David Peterson that takes on that question. Are "epistemic activists" in psychology redefining what it means to be objective in science? Does a focus on reforming incentives mean we view scientists as economic actors for whom motives and dispositions are irrelevant? Does the last decade's growth in meta-research mean that meta-analysis is the new arbiter of objectivity? Does a shift to a systems perspective on science have parallels in other systemic analyses...2020-07-291h 05

The Black GoatThe Impending Fall of AcademiaThe upcoming academic term will be unusual, to say the least. The global pandemic led to emergency shutdowns in March, and it is likely that many colleges and universities will continue teaching partially or wholly online. And protests against anti-Black racism in the United States and elsewhere have led to institutional statements about taking an antiracist stand - which may or may not translate into real change. In this episode, we discuss some of the changes and how we are thinking about them in our work. How did we adapt our teaching for remote learning, and what do we...2020-07-161h 07

The Black GoatInexact ScienceScientific knowledge is always contingent and uncertain, even when it's the best we have. Should that factor into how we communicate science to the public, and if so, how? We discuss a recent article about the effects of communicating uncertainty on people's trust in scientific findings and scientists. When should and shouldn't scientists communicate uncertainty, and how should they do it? How should scientists prioritize keeping people's trust versus being up front about what they don't know? What are the different sources of uncertainty in scientific knowledge, and how should scientists deal with all of them? Plus, we get...2020-04-301h 07

The Black GoatCOVID OperationsThe COVID-19 pandemic is creating major and serious disruptions to just about everything, and higher education is no exception. In this episode we talk about how our work has been affected by measures to slow down the coronavirus. How have we adjusted to remote teaching? What effects have the social distancing measures had on our research? How are we mentoring students in light of such an uncertain future? What bigger changes and disruptions could be in store for academia? Plus: We answer a letter about when and how students should draw on their expertise when their advisor is in...2020-04-151h 02

The Black GoatJoe Public, Will You Marry Me?In recent years there has been a lot of talk about public trust in science - how much there is, in what ways, whether we deserve it or not. In this episode, we discuss an article by historian and philosopher Rachel Ankeny that asks whether "trust" is even the right concept to be talking about. What does it mean to trust an abstraction like "science"? When people argue about trust in science, are they even talking about the same thing - the findings, the people, the process, or something else? And we discuss Ankeny's proposed alternative: that instead of...2020-04-011h 00

The Black GoatJust Be CauseMany important questions about cause and effect are impractical to answer with a randomized experiment. What should we do instead? In this episode we talk about doing causal inference with observational data. Has psychology's historical obsession with internal validity led it, ironically, to think about causal inference in an unsophisticated way? Can formal analytic tools like directed acyclic graphs (DAGs) tell us how to do better studies? Or is their main lesson don't bother trying? How do norms and incentives in publishing help or hurt in doing better causal inference? Plus: We answer a letter about applying to psychology...2020-03-211h 07

The Black GoatAuxiliary Turtles All the Way DownThe path from theory to study consists of a thousand decisions, big and small. How and how much do these decisions matter? We discuss a recent crowdsourced meta-study that tried to find out. Fifteen teams of researchers were given 5 different hypotheses and told to design a study to test them, then they ran all the studies and got widely varying results. What are the implications of this study for how we should think about the role of theory in study design? What does it say about the different functions of direct and conceptual replications? Is this evidence of hidden...2020-02-121h 08

The Black GoatThe Expertise of DeathHow important is expertise in conducting replications? Many Labs 4 was a large, multi-lab effort that brought together 21 labs, running 2,220 subjects, to study that question. The goal was to compare replications with and without the involvement of the original authors to see if that made a difference. But things got complicated when the effect they chose to study - the mortality salience effect that is a cornerstone of terror management theory - could not be replicated by anyone. In this episode, we talk about the implications of Many Labs 4. What does and doesn't this study say about the importance of...2020-01-291h 10

The Black GoatGoing Off the RecordThe Graduate Record Exam - the GRE - is widely used in graduate school admissions. In recent years however, a number of graduate programs, including a few in psychology, have stopped requiring it in a movement that has been dubbed "GRExit." In this episode we discuss the arguments around using the GRE in graduate admissions. What is the evidence for and against its validity? For and against the presence of bias against various groups? How much do we know about validity and bias in the other materials routinely considered in admission, like grades, undergraduate institution, research experience, and letters...2020-01-171h 14

The Black GoatThe Year 2019 in ReviewIn our annual end-of-year episode, we talk about noteworthy reflections and events from the year that just passed. Alexa reflects on breakups, and wonders why we don't take them more seriously as a significant disruption to other people's lives. Sanjay talks about hitting a low point and deciding to finally do something about it. And Simine talks about starting a new relationship and finding a new job that will take her halfway around the world. Plus: we answer a letter about whether scientists should mix advocacy and science. The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine...2019-12-261h 03

The Black GoatLetting Loose Your Inner Reviewer TwoPeer review is a major part of how science works today. In this episode we talk about how we approach doing peer reviews. How do you distinguish between differences in approach or preference - "I would have done it a different way" - versus things that you should treat as objections? How much weight do you put on different considerations - the importance of the research question, the novelty, the theory, the methods, the results, and other factors? What's your actual process - do you read front-to-back, or jump around? How much do you edit and wordsmith your reviews...2019-12-121h 12

The Black GoatDoctorpiece TheaterTo get your PhD you have to do a dissertation. For some this is an important product that demonstrates your ability to produce original research. To others, it's a vestigial ritual and a waste of time on the way to becoming a productive scholar. In this episode we discuss dissertations - what they've been in the past, what they are today, and where they might go in the future. Is a dissertation necessary for the kinds of work that someone might do with a PhD? As graduate training has evolved, how well has the dissertation kept up? Are oral...2019-11-291h 04

The Black GoatThe Last StrawSpeaking up about injustice and bad behavior in a professional setting - as a witness, or as the target of it - is hard. It's uncomfortable, it's difficult, and it can generate backlash and other risks for yourself and your career. In this episode, we talk about that moment when people finally decide to say something or do something. Simine shares the story of how she decided to go on the record about being groped at a conference - what brought her to that decision, and what happened as a result. And we talk about other cases of people...2019-11-131h 07

The Black GoatTalk the TalkAcademics give a lot of talks. Job talks, conference talks, colloquium talks, brownbag talks, pub talks. In this episode we talk about talks. How do you approach different audiences and formats? How do you manage a format or audience where interrupting with questions is the norm? How, and how much, do you prepare for different kinds of talks? How do you handle nerves when the stakes feel high? We share some of our own observations and experiences about giving academic presentations. Plus: We answer a letter about how "alt-acs" are perceived within academia. The Black Goat is...2019-10-301h 06

The Black GoatEverybody Act NormalScientists have to follow a lot of rules. We have IRB rules, journal submission rules, university rules - lots of rules. But some of the most important rules in science aren't rules at all - they are norms. Guiding principles that shape the work we do. In this episode, we discuss a classic paper by the sociologist Robert Merton on 4 norms that govern scientific work. Are these norms an expression of scientific values, or just a means to an end? How well do scientists follow them, individually or collectively? Is science doing as well today as Merton thought it...2019-10-161h 15

The Black GoatFor the LulzIn a previous episode we talked about making small talk in academic life and in general. In this episode we continue the theme, taking a break from our usual Very Serious Topics to answer the ultimate small-talk question: What do you do for fun? We talk about what a week in our lives is like outside of work. How do we spend time when we're not "on the clock"? What is the right amount of socializing? (spoiler: not everybody has the same answer) How do our hobbies and avocations reflect back on our work - or give us a...2019-10-031h 01

The Black GoatWho Do You Serve?The three pillars of academic work are research, teaching, and service - in that order. But service is incredibly important for universities and professions to function well and for academics to contribute to their communities. In this episode we talk about how we think about service. How do decide what service to do, and how much? How do you manage service in relation to your other work? What are different kinds of service, and what do you get out of them? What should we do about colleagues who get less service because they won't do it or will do...2019-09-181h 00

The Black GoatAxe Grinders BegoneIn the past decade, scientists in psychology and elsewhere have changed a lot in how we evaluate what makes research replicable, robust, and credible. New theories and findings in metascience and methodology - and repopularization of old ones - have given us new ways to think critically about research. But what do we do when these concepts and arguments are used poorly or bad faith - applied wrongly or selectively, or misused to sow broad doubt in science? In this episode we talk about what happens when people try to claim the mantle of open science to advance some other...2019-09-041h 03

Two Psychologists Four BeersBetter Advice (with Alexa Tullett)Yoel and Mickey welcome Associate Professor of Psychology, Alexa Tullett from the University of Alabama to the podcast. Co-host of The Black Goat podcast and board member of the Society for the Improvement of Psychological Science (SIPS), Alexa talks about being a Canadian early career researcher working in the US. What research is Alexa most excited about these days? How did she become interested in meta science? What advice would she give to non-Americans thinking of working in academia in the US? How did the Black Goat podcast come about? Bonus: Follow-up on the effect of parenting...2019-08-211h 05

The Black GoatA Friend You Haven't MetPart of academic life means talking to new people about yourself and your work - whether it's on a job interview, at a conference, or casual conversations outside of academic settings. In this episode we talk about talking to strangers. How do you answer default academic small-talk questions like "tell me about your work?" How do you shake out of them to move a conversation somewhere more interesting? Should you prepare or practice an elevator pitch? And when, if ever, is it safe to take off your headphones on an airplane? Plus: We try to answer a letter about...2019-07-241h 04

The Black GoatSimine Flips OutEditors of scientific journals have a lot of power. For one thing, journals are the main way that scientific work is distributed, so editors' decisions control the flow of information among scientists and to the public. For another, publications are probably the single most consequential product in evaluating scientists for jobs and career advancement. Simine just wrapped up a term as an editor of a journal, and in this episode she reflects on how much power she had, why it was probably too much, and what she could do next about that. Her big idea is to "flip" herself...2019-07-031h 02

The Black GoatBring the PainResearch methods and statistics are a part of nearly every undergraduate psychology curriculum. They get dedicated courses of their own as well as coverage within other courses. In this episode we step back and reflect on how they should fit into an undergraduate curriculum and how we should be teaching them. Can and should we try to teach them important concepts without the underlying math? How do we integrate methodology into "substantive" teaching about psychology theories and findings? What should we do with the knowledge that many, probably most of our students will never calculate a correlation coefficient or...2019-06-2658 min

The Black GoatThis is How We Do ItMany academics have flexibility in when, where, and how they get work done. In this episode we talk about the work habits we've developed to be productive, and the ones we've tried on that didn't fit. What are the differences between working in an office, at home, at a cafe, or elsewhere? How do you create routines and protect your time to get things done? Is it better to work with other people or alone? How do you recognize when the advice that works for everybody else doesn't work for you? Plus: With some help from sociologist Jill Harrison...2019-06-1355 min

The Black GoatWho's Down with OPG?Most doctoral training in psychology follows an apprentice model: Grad students affiliate with a primary advisor and lab, and do most of their training under that one person. But what happens when grad students and professors develop professional relationships outside of that traditional model? In this episode we discuss the politics and etiquette of students and faculty interacting and working together outside of the advisor-advisee model. How much control do - and should - advisors have over their advisees? How should faculty go about supporting and criticizing the work of students from other labs? What are the issues involved...2019-05-291h 07

The Black Goatlibrary(blackgoatpod)To users of R, it is more than just another way to analyze data - it goes along with a different mindset about the centrality of coding in doing science, a way of thinking about openness and reproducibility, an intersecting set of tools, and a community of users with its own culture and mindset. In this episode we talk about the rise of R within the psychology research community. How has the importance of statistical software changed over time? Should we be teaching R to grads and undergrads? What have our own experiences learning new software been, and can...2019-05-151h 00

The Black GoatDon't Be Told What You Want, Don't Be Told What You NeedWhat if there were no journals? Would academic life be barren and empty, noisy and chaotic, happy and egalitarian, or something else entirely? In this episode we conduct an extended thought experiment about life without journals, in order to probe questions about what journals actually do for us anyway, what are other ways to achieve those things, and how we might overcome the downsides of the current scientific publishing ecosystem. How else could peer review work? How would researchers find information and know what to read? Would we just replace our current heuristics and biases with new ones? Plus...2019-05-011h 05

The Black GoatDon't Say IntegrityWhat is the connection between methodology and ethics? In the early days of the twenty-teens, some people referred to the changes afoot in psychology as a "scientific integrity movement," but that term quickly faded. In this episode, we explore the connections between scientific rigor and scientific ethics. What are the ethical dimensions of good methods? When do we have an ethical obligation to make sure that our studies can answer our questions? Are there ethical obligations that go beyond considerations around protecting human subjects? Why do we sometimes shy away from connecting science reform with ethical behavior? Plus: We...2019-04-171h 01

The Black GoatOh, Behave!Psychology calls itself a behavioral science, but how often do we measure actual behavior? In this episode we discuss what is involved in measuring realistic, meaningful behavior in psychology research - not just self-reports and response times. What counts as "behavior" anyway? Why does it seem like psychologists measure less behavior than they used to? What are the scientific, professional, or logistical reasons why researchers decide not to measure behavior? Our discussion is anchored around an article by Roy Baumeister, Kathleen Vohs, and David Funder with the delightful title "Psychology as the Science of Self-Reports and Finger Movements: Whatever...2019-03-201h 05

The Black Goat13/10 Would Criticize AgainIf you are a scientist, criticizing science is a part of the job. We write peer reviews of papers and grants; after talks we ask questions, make comments, and ask questions that are more of a comment; and sometimes we even run replications or new studies to test each other's conclusions. But the scientific ecosystem does not have people who hold the dedicated job of science critic, in the way that fields like art, theater, and music have critics. In this episode we consider an argument made by philosopher Don Ihde that the scientific ecosystem needs such people too...2019-03-061h 04

The Black GoatOur Best Episode EverSelf-promotion: the idea makes some people cringe and others salivate. In this episode, we talk about self-promotion in academic science. What amount - and maybe more importantly, what kind - is right? Why do some people shy away from it while others dive in? What even counts as self-promotion? Is it a luxury to be able to do without active self-promotion? How do cultural and other differences play into self-promotion? Plus: We answer a letter about bringing open science practices into clinical psychology. Links: Leveraging the open science framework in clinical psychological assessment research, by Jennifer...2019-02-201h 04

The Black GoatConference TalkLove them or hate them, conferences are a big part of academic life. In this episode we talk about getting the most out of a conference experience. How do you meet people (the dreaded "networking") and make the transition from feeling awkward to comfortable when you're new to a conference? How do you decide what to go to and what to skip? What are the etiquette and norms you should know about? How does the experience of going to a conference change over the course of your career? We share our tips, experiences, and stories from over the years...2019-02-061h 03

The Black GoatBack From The FutureWhether you call it a crisis, a renaissance, a revolution, or something else, there is no doubt that psychology is in the middle of a period of great change. How will future historians, scientists, and others look back on this moment in our field's history? We speculate on what changes we think will stuck, whether some things will look silly or naive in hindsight, what new problems or issues will rise in importance, and more. Plus: We respond to a letter about whether, when, and how to disclose a disability during the job search (and we invite feedback from...2019-01-231h 00

The Black GoatSelf-Help Helps Those Who Self-Help ThemselvesGo to the "Psychology" section in a bookstore and chances are it will be full of self-help books. In this episode we talk about self-help and its relationship to academic psychology. What is the difference between a scientist and a self-help guru? How do we feel about the ways that self-help books talk about empirical research, and do we think they should do more of that or less of it? What self-help books have we read, and what did we think of them? Plus: We answer a letter from a n00b assistant professor who wants grad students to...2019-01-091h 03

The Black GoatThe Year 2018 In ReviewContinuing an annual tradition, for our last episode of 2018 we talk about noteworthy events and reflections from our lives in the past year. Alexa finds that she's growing more sentimental with age. Alexa and Sanjay commune over rediscovering reading books for pleasure. Sanjay muses about the legitimate benefits of taking a sabbatical. Simine reflects on the joys of meeting new people and reinventing yourself on the road. Plus: We answer a letter about how you now when a place of work is "the one"? The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. F...2018-12-261h 02

The Black GoatBody TalkMany psychologists study the brain or the body in relation to the mind. Alexa once thought psychophysiology and neuroscience would become a central part of her research; Sanjay flirted with the idea; Simine never seriously considered it. In this episode, we talk about how we see neuroscience and psychophysiology in relation to our own work. How well would those areas integrate into the research each of us does? What sorts of psychological questions are they not particularly well suited for? What do we think they are good for? What kinds of things do we learn from our colleagues who've...2018-12-121h 08

The Black GoatThis Time Could Be Different (with Fiona Fidler)The open science movement is not the first time psychology has tried to reform itself. Why do some scientific reform movements succeed and others fizzle out? In this episode we talk with Fiona Fidler, a philosopher and historian of science at the University of Melbourne. Fiona's doctoral thesis was an investigation of a decades-spanning attempt to reform statistical practice in psychology based on critiques of null hypothesis significance testing. Her research included interviews with reform proponents like Patricia Cohen, Paul Meehl, and Robert Rosenthal; reviews of the correspondence and output of the APA Task Force on Statistical Inference; and...2018-11-281h 07

The Black GoatRelevant To Your InterestsScientists, like all humans, care about more than one thing in life. Scientists want to discover true or useful things about the world. But we are not indifferent to money, prestige, loyalty to friends and family, or other important things. How should scientists deal with situations where more than just our pure scientific ideals are on the line? In this episode we discuss conflicts of interest. What are conflicts of interest anyway? What are commonly occurring ones? Why does our field of psychology seem to have an underdeveloped set of norms and regulations for dealing with them? And how...2018-11-141h 04

The Black GoatBeing DifferentIn this episode we tell personal stories about being different, and we reflect on how our identities and experiences - in life and in professional spheres - have been shaped by that. Sanjay talks about growing up multiracial and trying to figure out what that meant while the world was trying to define it for him. Simine talks about not conforming to gender expectations and the assumptions and reality about sexual orientation that go with that. Alexa talks about how her understanding of her own romantic and sexual attractions and interests evolved over time and how she started dating wom...2018-08-221h 33

The Black GoatWe Were Never CoolAlexa studies how our beliefs change them over time. Simine studies self-knowledge and what others know about us. And Sanjay studies lifespan development. So this episode we are going to go full me-search and talk about what we were like as kids, how we’re the same and how we have changed into who we are now. Were any of us cool in high school? (Spoiler: No.) And how did going into academia change who we were? And in our letter of the week, we talk about how to keep up with what can seem like a firehose of new met...2017-11-151h 02

The Black GoatThe Learning CurveWhen you're faculty at a research university, you get mixed messages about teaching: it's a big part of the job, but you get all kinds of not-so-subtle messages that you are supposed to think of yourself as a researcher first. In today's episode, we talk about where teaching fits into our identities and values, and how that has evolved over our careers. Alexa talks about her experiences volunteering to teach in a prison; Simine tells how she found a way to be her quiet, skeptical self in front of hundreds of people; and Sanjay talks about looking for the overla...2017-11-011h 04

The Black GoatThe Meaning of It All (with Anna Alexandrova)Scientists often turn to philosophers for answers to the big questions about science: what is the meaning of what we do, what makes it valid, why does it even matter? In this episode we put all our thorniest questions to our guest, Anna Alexandrova. Anna is a philosopher of science at Cambridge University and author of the new book A Philosophy for the Science of Well-Being. We talk about replicability and reform in science, what scientists can learn from philosophy beyond the Popper-Kuhn-Lakatos canon, the important role of norms in scientific discourse, and how you do science on values-laden concepts...2017-10-041h 13

The Black GoatSIPSapaloozaThe Society for the Improvement of Psychological Science, or SIPS, held its second conference July 30 - August 1, 2017. SIPS is a new organization that works to improve methods and practices in psychology. The conference is unlike a typical academic meeting -- instead of symposia and keyones, the schedule is filled with hackathons, unconferences, and more. In the first part of this episode, we talk about where SIPS came from and what it is all about. Then we present conversations that we recorded with SIPS attendees. Interviews: Alexa talks to three SIPS veterans: Brett Mercier, Dylan Wiwad, and Alex...2017-08-231h 02

The Black GoatIt's So ComplicatedAll three of us were all around, at various career stages, before the "replicability crisis" became a thing. In today's episode we each share stories of our personal journeys with the larger replicability discussion in psychology, and how we went from clueless to naively optimistic to whatever we are today. Plus: A letter-writer asks how to respond to an advisor who asks you to p-hack. And Alexa tells how her students reacted to her telling them that she is an atheist. Links: Do-Gooder Derogation: Disparaging Morally Motivated Minorities to Defuse Anticipated Reproach, by Julia Minson and Benoit Monin How Many Athe...2017-06-281h 07

The Black GoatNullius in verbaWhen a group of "natural philosophers" got together to found the Royal Society in 1660 - now the oldest scientific society in the world - they chose as their motto a Latin phrase meaning "Take nobody's word for it." In today's episode we talk about the role of trust in science. Trust can mean many things, and we talk about its tension with scientific verifiability, people's desire for trusting relationships and culture in their field, and the practical value of trust in doing our work. Plus: A letter about whether pressures to fit the mold of a job description or graduate pro...2017-06-141h 07

The Black GoatEpisode 3: No, You're The ImpostorHave you ever experienced impostor syndrome? Meta-impostor syndrome (everyone else just has impostor syndrome but you're right about yourself)? We talk about mental health and all the ways you can feel terrible as an academic. In our opening segment we discuss Alexa's brush with a misconduct case, Simine's new article on how journal articles are like new cars, and a reviewer getting in trouble for wanting to see data. And in our letter of the week, what do you do when a reviewer tells you to HARK? Articles and blog posts discussed in this episode: Duplicating Dat...2017-03-2359 min