Shows
Freakonomics RadioCan Academic Fraud Be Stopped? (Update)Probably not — the incentives are too strong. But a few reformers are trying. We check in on their progress, in an update to an episode originally published last year. (Part 2 of 2) SOURCES:Max Bazerman, professor of business administration at Harvard Business School.Leif Nelson, professor of business administration at the University of California, Berkeley Haas School of Business.Brian Nosek, professor of psychology at the University of Virginia and executive director at the Center for Open Science.Ivan Oransky, distinguished journalist-in-residence at New York University, editor-in-chief of The Transmitter, and co-founder of Retraction Watch.Joseph Simmons, pro...2025-01-021h 08Freakonomics RadioWhy Is There So Much Fraud in Academia? (Update)Some of the biggest names in behavioral science stand accused of faking their results. Last year, an astonishing 10,000 research papers were retracted. In a series originally published in early 2024, we talk to whistleblowers, reformers, and a co-author who got caught up in the chaos. (Part 1 of 2) SOURCES:Max Bazerman, professor of business administration at Harvard Business School.Leif Nelson, professor of business administration at the University of California, Berkeley Haas School of Business.Brian Nosek, professor of psychology at the University of Virginia and executive director at the Center for Open Science.Joseph Simmons, professor of a...2024-12-261h 15
a16z PodcastPrediction Markets and BeyondThis episode was originally published on our sister podcast, web3 with a16z. If you’re excited about the next generation of the internet, check out the show: https://link.chtbl.com/hrr_h-XCWe've heard a lot about the premise and the promise of prediction markets for a long time, but they finally hit the main stage with the most recent election. So what worked (and didn't) this time? Are they really better than pollsters, is polling dead? So in this conversation, we tease apart the hype from the reality of prediction markets, from the...2024-12-021h 49
web3 with a16z cryptoPrediction Markets and Beyondwith @atabarrok @skominers @smc90We've heard a lot about the premise and the promise of prediction markets for a long time, but they finally hit the main stage with the most recent election. So what worked (and didn't) this time? Are they better than pollsters, journalists, domain experts, superforecasters?So in this conversation, we tease apart the hype from the reality of prediction markets, from the recent election to market foundations... going more deeply into the how, why, and where these markets work. We also discuss the design challenges and opportunities, including implications for builders...2024-11-221h 48
Clearer Thinking with Spencer GreenbergHighs and lows on the road out of the replication crisis (with Brian Nosek)Read the full transcript here. How much more robust have the social sciences become since the beginnings of the replication crisis? What fraction of replication failures indicate that the original result was a false positive? What do we know with relative certainty about human nature? How much of a difference is there between how people behave in a lab setting and how they behave out in the world? Why has there been such a breakdown of trust in the sciences over the past few decades? How can scientists better communicate uncertainty in their findings to the public...2024-11-091h 38
SURFshortWat je moet weten over... open scienceWetenschap is van iedereen voor iedereen en zou voor iedereen beschikbaar moeten zijn. Dat is het basisprincipe van open science. Dat klinkt logisch toch? Of zijn er ook gegronde redenen om wetenschap niet open te stellen? We spreken John Doove, programmamanager open science bij SURF. Hij werkt al 17 jaar vol overtuiging aan open science. Hoe was het toen? Waar staan we nu en wat wordt er verwacht van onderzoeksinstellingen? Luister nu de nieuwe aflevering van SURFshort.
Wil je meer weten over open science? Kijk op surf.nl/openscience of volg de tips van John:
Ga naar...2024-10-1617 minClearer Thinking with Spencer GreenbergWhat do we know for sure about human psychology? (with Simine Vazire)Read the full transcript here. How much progress has psychology made on the things that matter most to us? What are some psychological findings we feel pretty confident are true? How much consensus is there about the Big 5 personality traits? What are the points of disagreement about the Big 5? Are traits the best way of thinking about personality? How consistent are the Big 5 traits across cultures? How accurately do people self-report their own personality? When are psychophysical measures more or less useful than self-report measures? How much credence should we lend to the concept of cognitive dissonance...2024-09-121h 21
The Studies ShowEpisode 49: Scientific publishingIt’s in a peer-reviewed paper, so it must be true. Right? Alas, you can only really hold this belief if you don’t know about the peer-review system, and scientific publishing more generally.That’s why, in this episode of The Studies Show, Tom and Stuart break down the traditional scientific publishing process, discuss how it leads science astray, and talk about the ways in which, if we really cared, we could make it better.The Studies Show is brought to you by Works in Progress magazine. Their new September 2024 issue is out now, and is...2024-09-101h 16
On Tech Ethics with CITI ProgramOpen Science Principles, Practices, and Technologies - On Tech EthicsThis episode discusses the principles, practices, and technologies associated with open science and underscores the critical role that various stakeholders, including researchers, funders, publishers, and institutions, play in advancing it. Our guest today is Brian Nosek, the co-founder and Executive Director of the Center for Open Science and a professor at the University of Virginia, who focuses on research credibility, implicit bias, and aligning practices with values. Brian also co-developed the Implicit Association Test and co-founded Project Implicit and the Society for the Improvement of Psychological Science. Additional resources: Center for Open Science: http...2024-08-0629 minFreakonomics Radio573. Can Academic Fraud Be Stopped?Probably not — the incentives are too strong. Scholarly publishing is a $28 billion global industry, with misconduct at every level. But a few reformers are gaining ground. (Part 2 of 2) SOURCES:Max Bazerman, professor of business administration at Harvard Business School.Leif Nelson, professor of business administration at the University of California, Berkeley Haas School of Business.Brian Nosek, professor of psychology at the University of Virginia and executive director at the Center for Open Science.Ivan Oransky, distinguished journalist-in-residence at New York University, editor-in-chief of The Transmitter, and co-founder of Retraction Watch.Joseph Simmons, professor of applied stat...2024-01-181h 02Freakonomics Radio572. Why Is There So Much Fraud in Academia?Some of the biggest names in behavioral science stand accused of faking their results. Last year, an astonishing 10,000 research papers were retracted. We talk to whistleblowers, reformers, and a co-author who got caught up in the chaos. (Part 1 of 2) SOURCES:Max Bazerman, professor of business administration at Harvard Business School.Leif Nelson, professor of business administration at the University of California, Berkeley Haas School of Business.Brian Nosek, professor of psychology at the University of Virginia and executive director at the Center for Open Science.Joseph Simmons, professor of applied statistics and operations, information, and decisions a...2024-01-111h 14
BJKS Podcast84. Brian Nosek: Improving science, the past & future of the Center for Open Science, and failure in scienceBrian Nosek is a professor of psychology at the University of Virginia, and Co-founder and Executive Director of the Center for Open Science. In this conversation, we discuss the Center for Open Science, Brian's early interest in improving science, how COS got started, what Brian would like to do in the future, and how to figure out whether ideas are working.BJKS Podcast is a podcast about neuroscience, psychology, and anything vaguely related, hosted by Benjamin James Kuper-Smith.Support the show: https://geni.us/bjks-patreonTimestamps00:00: Brian's early interest in improving science2023-12-081h 02
Meikles & Dimes103: Brian Nosek | From Ruining His Career to Revolutionizing ScienceBrian Nosek is a social-cognitive psychologist, professor at the University of Virginia, and co-founder and director of the Center for Open Science. In 2011, Brian and his colleagues launched the Reproducibility Project which would ultimately transform science forever.
In this episode we discuss the following:
Reputation is how people perceive us. But integrity is what we get to choose for ourselves.
We can hold ourselves accountable for our integrity, but when we worry about our reputation, we’re prone to get led astray.
If we try to control our reputation, we’re prone to avoid risk (e.g...2023-11-2822 min
Fularsız EntellikDavranışsal Ekonomi 4: Dürüstlük Hakkında Yalanlar ve Tekrarlanabilirlik KriziDavranışsal ekonomi balonunu şişirdik şişirdik, artık indiriyoruz. Çeşit çeşit sahtekarlıktan oluşan bir dedektiflik hikayesi oldu. İki başrol oyuncumuz var, ben de finali iki kısma ayırdım: Bugünkü kısım Dan Ariely'nin dürüstlük çalışmalarına odaklı. Aynı zamanda tekrarlanabilirlik krizi üstünden bilimin nasıl düşe kalka ilerlediğini de göreceğiz. Tüm kaynaklar aşağıda her zamanki gibi, patronlarıma patroniçelerime teşekkürler..Konular:(00:05) Davranışsal Balon(02:05) Önceki bölümlerin özeti(04:20) Dan Ariely(06:41) 10 Emir çalışması(08:13...2023-11-1221 min
AUDIT 15 FUNEpisode 108 - Data Controversy - Brian NosekIn the latest AUDIT 15 FUN episode, I interviewed Brian Nosek, a professor at the University of Virginia and Executive Director at the Center for Open Science, about Francesca Gino, a dishonesty researcher accused by the Data Colada team of data fraud.
What evidence did the Data Colada team provide to support the fraud allegations?
Are there alternative explanations that could clear Gino of any wrongdoing?
In the broader context, how can we ensure researchers maintain honesty in their work?
...2023-10-0121 min
R3ciprocity.com - Prof David Maslach: Innovation; Research Life; & Striving Towards HappinessBrian Nosek On Courage & Creating The Open Science FoundationProfessor Brian Nosek discusses the importance of courage and how to navigate difficult challenges and questions in science.
Brian Arthur Nosek is a social-cognitive psychologist, professor of psychology at the University of Virginia, and the co-founder and director of the Center for Open Science. He also co-founded the Society for the Improvement of Psychological Science and Project Implicit. Brian Nosek received a Ph.D. in from Yale University in 2002 and is a professor in the Department of Psychology at the University of Virginia.2023-09-2854 min
The Ongoing TransformationOpen Science: Moving from Possible to Expected to RequiredA decade ago, University of Virginia psychology professor Brian Nosek cofounded an unusual nonprofit, the Center for Open Science. It’s been a cheerleader, enabler, and nagger to convince scientists that making their methods, data, and papers available to others makes for better science.
The Center for Open Science has built tools to register analysis plans and hypotheses before data are collected. It campaigns for authors and journals to state explicitly whether and where data and other research materials are available. Gradually, practices that were considered fringe are becoming mainstream. The White House declared 2023 the Year of Ope...2023-09-2631 min
The HPS Podcast - Conversations from History, Philosophy and Social Studies of ScienceBONUS EPISODE - Simine Vazire on 'Making Science Better'Welcome to a special bonus episode of The HPS Podcast with Professor of Psychology, Simine Vazire, discussing the ways in which HPS scholars and scientists can work together to create better science.We are releasing the episode to coincide with the campaign put together by Simine and others to support the legal defence of Data Colada – a group of professors who identify concerns with the integrity of published research. Members of Data Colada are being sued by Francesca Gino, a Harvard Business School Professor, after they published blog posts raising concerns about the data integrity of four pa...2023-08-1823 min
Historically ThinkingEpisode 313: Intellectual Humility, Social Psychologically SpeakingThis is the second of our continuing series on intellectual humility and historical thinking.
Today I'm interested in exploring the social science of intellectual humility. Igor Grossman is a social psychologist, an Associate Professor of Psychology at the University of Waterloo in Canada. “Most of our work,” he writes, describing his lab, “either focuses on how people make sense of the world around them—their expectations, lay theories, meta-cognitions, forecasts—or it concerns how larger cultural forces impact human behavior and societal change.” That makes him the perfect person to talk to about intellectual humility, and historical thinking.
For Further Investigatio...2023-04-1751 min
The Science of SuccessSelf Help For Smart People - How You Can Spot Bad Science & Decode Scientific Studies with Dr. Brian NosekIn this episode, we show how you can decode scientific studies and spot bad science by digging deep into the tools and skills you need to be an educated consumer of scientific information. Are you tired of seeing seemingly outrageous studies published in the news, only to see the exact opposite published a week later? What makes scientific research useful and valid? How can you, as a non-scientist, read and understand scientific information in a simple and straightforward way that can help you get closer to the truth - and apply those lessons to your life. We discuss this...2023-04-1354 min
The Jim Rutt ShowCurrents 075: Michael Nielsen on MetascienceJim talks with Michael Nielsen about the ideas in his and Kanjun Qiu's recent essay, "A Vision of Metascience: An Engine of Improvement for the Social Processes of Science"...
Jim talks with Michael Nielsen about the ideas in his and Kanjun Qiu's recent essay, "A Vision of Metascience: An Engine of Improvement for the Social Processes of Science." They discuss the meaning of metascience, a vivid example in Genovese maritime insurance, attracting intellectual dark matter, creation & limitations of the h-index, frozen accidents in our scientific operating system, what allowed the original DARPA to be so productive, funding-by-variance, failure audits, changing th...2022-12-061h 01
The Skate PodcastKrejci and second line get going, Nosek extends his point streak to 4 gamesEp. 135 (pt. 1): Brian, Bridgette and Scott go through key performances in the Bruins' win over the Flyers. How Krejci and Nosek have gotten going offensively. Why Jim Montgomery is tinkering with his forward lines so much. Follow us on Twitter: @TheSkatePod | @smclaughlin9 | @briandefelice_ | @bridgetteproulx To learn more about listener data and our privacy practices visit: https://www.audacyinc.com/privacy-policy Learn more about your ad choices. Visit https://podcastchoices.com/adchoices2022-11-1826 minThe Skate PodcastTomas Nosek ends his drought, Craig Smith gets scratched againEp. 133, Part 2: Brian and Scott dive into the Bruins' bottom six, where Tomas Nosek ended his goal drought, Craig Smith got scratched, and A.J. Greer electrified the Garden crowd with a fight. To learn more about listener data and our privacy practices visit: https://www.audacyinc.com/privacy-policy Learn more about your ad choices. Visit https://podcastchoices.com/adchoices2022-11-1420 min
The Not Unreasonable PodcastBrian Nosek on the Gap Between Values and ActionsBrian Nosek, has been at the center of the two most important recent social revolutions in academia. First is implicit bias where Brian co-founded Project Implicit http://projectimplicit.net/ based on a pretty incredible idea: that we don't do what we say we value. The concept of implict bias has really taken off and the practice of implicit bias detection and training has gone "way out in front of the research" as we discuss.While he was busy kicking off a fundamental change in our society (felt very strongly in academia) he decided to upend (and massively upgrade...2022-10-081h 10
Everything Hertz161: The memo (with Brian Nosek)Dan and James are joined by Brian Nosek (Co-founder and Executive Director of the Center for Open Science) to discuss the recent White House Office of Science Technology & Policy memo ensuring free, immediate, and equitable access to federally funded research. They also cover the implications of this memo for scientific publishing, as well as the mechanics of culture change in science.
Open Science Framework hits half a million users
The White house memo
Brian on Twitter
Other links
Everything Hertz on social media
Dan on twitter
James on twitter
Everything Hertz on twitter
Everything Hertz...2022-09-1247 min
Open UpdateInterview Brian Nosek - Scientific UtopiaIn our first interview of season 2, we talk to Brian Nosek about the past, present, and future utopias of open science, in light of the UNESCO Recommendation on Open Science. For listeners who prefer, we also have a transcript available.
Leave us a voice message with your thoughts 😊 (no log-in required)
PEOPLE behind the podcast
Host: Chris Hartgerink
Mixing: Bjorn Uyens
Artwork: Patrick Sobrak-Seaton as adapted by Chris Hartgerink
Contact: info@libscie.org or @libscie2022-05-3130 min
Open UpdateSeason 2 teaserStarting May 31st, the Open Update is back for its second season. In nine interviews we explore the UNESCO recommendation on open science from a variety of perspectives.
Our guests include:
Brian Nosek
Samuel Moore
Iryna Kuchma
James Bridle
Tamarinde Haven
Wendy Ingram
Monica Granados
Shilaan Alzahawi and Meng Liu (from the FORRT project)
Kaitlin Thaney
2022-05-2502 min
Stanford Psychology Podcast25 - Brian Nosek: The Pursuit of Open and Reproducible ScienceJoseph chats with Brian Nosek, co-Founder and Executive Director of the Center for Open Science. The Center's mission is to increase the openness, integrity and reproducibility of scientific research. Brian is also a professor of Psychology at the University of Virginia where he runs the Implicit Social Cognition Lab. Brian studies the gap between values and practices with the goal of understanding why the gap exists, its consequences and how to reduce it. Brian co-founded Project Implicit, a collaborative research project that examines implicit cognition - thoughts and attitudes that occur outside our awareness. In 2015, he was named one...2021-12-2351 min
Keeping Karlsson Fantasy Hockey PodcastNo. 356 - Offseason Action: Atlantic DivisionOn this episode of the Keeping Karlsson Fantasy Hockey Podcast, Elan and Brian are on to part 3 of our four-episode series covering all the fantasy implications of player movement coming via the draft, trade and free agent market. We use this show to take a look around the new faces and depth chart places in the Atlantic Division, where Florida and Boston loaded up for another Cup run while the rest of their competition made some small adjustments under the hood. How high can Sam Reinhart go as a Panther? Can Taylor Hall still be a high-end fantasy option...2021-08-041h 05
Dialogues with Richard ReevesJoseph Henrich on how religion changed sex, families and cultureWhat made some societies so individualistic, so democratic, and so rich? The short version of Joe Henrich’s answer is: religion. By undermining kin-based networks, universalizing religions (especially Western Christianity) prompted the “big innovation” of impersonal trust, altered the Western brain and laid the foundations for free markets, geographical mobility and democratic institutions. In other words, some people became WEIRD (Western, educated, industrialized, rich, democratic). We discuss how the concept of coevolution helps to get us past the tired nature v. nurture distinction, the role of culture in shaping our biology, how polygamy causes a “math problem of surplus men”, th...2021-06-281h 03
Speaking of PsychologyHow ‘open science’ is changing psychological research, with Brian Nosek, PhDIs psychology research in a crisis or a renaissance? Over the past decade, scientists have realized that many published research results, including some classic findings in psychology, don’t always hold up to repeat trials. Brian Nosek, PhD, of the Center for Open Science, discusses how psychologists are leading a movement to address that problem, in psychology and in other scientific fields, by changing the way that research studies get funded, conducted and published. Listener Survey - https://www.apa.org/podcastsurvey Learn more about your ad choices. Visit megaphone.fm/adchoices2021-06-1641 min
Two Psychologists Four BeersHow is Open Science Doing?Yoel and Alexa discuss progress in open science over the past 10 years. Is the scientific reform glass half-full or half-empty? Where have we made progress, and what still needs work? We use two papers describing "Scientific Utopia" by Nosek and colleagues (written nearly 10 years ago!) in order to evaluate our progress.
Also, the true story of how Ashley Madison got its name.Sponsored By:Paperpile: No-fuss reference management for the web. Manage your research library, right in your browser. Promo Code: BEERSLinks:Unibroue | Megadeth Saison 13Just the Juice - Prairie Artisan...2021-06-091h 26
Keeping Karlsson Fantasy Hockey PodcastNo. 338 - Do Juuse What I See?The fantasy season may be over, but that only means we're already thinking about the next one! On this episode of the Keeping Karlsson Fantasy Hockey Podcast, Elan and Brian share their Playoff Watch Lists of players they're closely observing this post-season to gain valuable data for next year's drafts. In a season that was barely half as long as normal, we share what we're hoping to glean from teams and players in the hunt over the course of the Stanley Cup Playoffs. Players discussed on this episode include Kirill Kaprizov, Marco Rossi, Mats Zuccarello, Juuse Saros, Filip Forsberg...2021-05-171h 24
The Escaped Sapiens PodcastBrian Nosek: Is science in (reproducibility) crisis? | Escaped Sapiens Podcast #12Brian Nosek discusses the reproducibility project, a crowdsourced collaboration of 270 authors, which attempted to repeat 100 published experimental and correlational psychological studies. When the results of the study were released in 2015 it was a shock to the scientific world: only 36% of the studies replicated, and of those that replicated, many of their results were smaller than those in the original papers. So is there only a problem in psychology or does it go much further?
Find out more about Brian's work at the Center for Open Science: https://www.cos.io/
2021-05-0951 min
Keeping Karlsson Fantasy Hockey PodcastNo. 333 - Schedule SommelierOn this episode of the Keeping Karlsson Fantasy Hockey Podcast, Elan and Brian rank every team's schedule from best to worst over the next 3 weeks, and then hunt for free agent value and roster bloat to give you all the info you need to optimize your NHL fantasy playoff rosters. How many Golden Knights are better than Reilly Smith? Can Colin Blackwell, Craig Smith or Jeff Skinner keep producing from their teams' top lines? How might Nikita Gusev fit into Florida's plans down the stretch? Do either John Gibson or Rickard Rakell deserve a second chance? Which Canucks and...2021-04-122h 10
The Jim Rutt ShowEP117 Samo Burja on Societal DeclineSamo Burja talks to Jim about his book, Great Founder Theory: theories & limits of history, institutions, design vs evolution, declining empires, and much more...
Samo Burja talks to Jim about his freely available book, Great Founder Theory. They cover long-lasting societies, theories & limits of history, cultures that prioritize documentation, long-term priorities, institutional organization, social technologies, design vs evolution, what makes a great founder, times of slow change, market reform dynamics, censorship, social coordination costs, social media reformation, centralized vs decentralized declining empires, closed vs open academic journals, pre-registered research, post-modernism, noble lies, technology & society connections, institutional decline, the overproduction of elit...2021-03-231h 54
The Dire Ed PodcastAn Alternative to Traditional Peer ReviewIn this episode, Professor Brian Nosek, Executive Director of the Center for Open Science, discusses an alternative to traditional peer review: the Registered Report. Full disclosure: your podcast host (Professor Andrew R Timming) is the inaugural Registered Reports Editor at Human Resource Management Journal!2021-03-0231 min
We Do the Heavy LiftingHilliard Discussion 10 Announcement VideoThe award winning Hilliard Discussions are back! But, there's a twist... Rather than the typical short lecture format, the Hilliard Discussions will be hosted as debates.
What will this look like, you ask? Well, we will have two experts on opposing sides of a certain topic in the area of sports medicine and human performance. Then, they will debate and respectfully argue their points backed by evidence from their research/experience. Sounds fun, I know!
Additionally, Hilliard Discussions will now occur semi-annually: one in January and one in September.
...2020-11-0503 min
開放咖啡角EP20_隨行外帶_20200920開放科學角Telegram頻道：https://t.me/open_cafe
PSA001 正式發表於Nature Human Behavior
Benedict Jones, Lisa DeBruine, et al. (2020) "To Which World Regions Does the Valence-Dominance Model of Social Perception Apply?" https://psyarxiv.com/n26dy
Lisa DeBruine 的推特串: https://twitter.com/LisaDeBruine/status/1306877908816982020
二次資料分析挑戰公布結果
Forscher, P. S., Noyce, A., DeBruine, L. M., Jones, B., Flake, J. K., Coles, N. A., & Chartier, C. R. (2020, May 26). Incentivizing Discovery through the PSA001 Secondary Analysis Challenge. URL
Tai Rage 網戰事件
網戰起源：網民科學家Alvaro de Menard評論科學再現危機的網誌與推特 https://twitter.com/AlvaroDeMenard/status/1304399437641461760
Tai Rage引戰文：https://twitter.com/tage_rai/status/1305593581084778504
Brian Nosek與其他學者、主要補補者在推特的反擊
Brian Nosek: https://twitter.com/BrianNose...2020-09-2017 min
Future TenseReinventing research – Part One: future scenarios and moving away from the publish or perish mantraThe research community is facing a “crisis of reproducibility”, according to the head of the Center for Open Science, Professor Brian Nosek. He says many of the traditional practices designed to make research robust, actually distort and diminish its effectiveness. In this episode, he details his ideas for reform. We also explore three plausible scenarios for how the academic sector could look in 2030.2020-09-2029 min
More of a Comment Than a QuestionTage-gate!This week, we talk about the controversy over a blog by an anonymous person on Twitter, AlvaroDeMenard, about participating in "Replication Markets, a part of DARPA's SCORE program, whose goal is to evaluate the reliability of social science research."The thread about this on Twitter elicited a response from an editor at Science, Tage Rai, and consequently, multiple responses to that from the Open Science community. Original thread by @AlvaroDeMenardhttps://twitter.com/AlvaroDeMenard/status/1304399437641461760Associated Blog: https://fantasticanachronism.com/2020/09/11/whats-wrong-with-social-science-and-how-to-fix-it/2020-09-191h 05
開放咖啡角EP3_協同合作解決危機這一集以2020年1月6號發表在Nature index的報導，介紹Brian Nosek發起的Many Labs專案。這些專案帶起許多心理科學家重視並實踐開放科學操作，以及透過跨國協同合作，累積高信賴度的研究成果。報導全文請點這個連結；節目中提到的音頻節目，OSF下載網址來自開放科學學習社群WEekly Learn Open Science Team (WE LOST): https://osf.io/pjv9g/ https://osf.io/9xfec/ 本節朗讀稿下載網址，錄音檔下載網址。2020-09-0409 min
The Body of EvidenceInterview - Elisabeth Bik, Science DetectiveJonathan and Chris interview Dr. Elisabeth Bik, a science detective who has dedicated herself to identifying and reporting image duplications in the scientific literature that can be due to errors… or to fraud. This interview is part of a continuing series on bad science, including the special “Science Is a Human Enterprise” (part 1 and part 2) and the interview with Dr. Brian Nosek. 1:16 How Dr. Bik became a science detective 3:28 Duplications 10:43 Music or no music? 11:10 Screening 20,000 papers for duplications 16:38 Speed versus accuracy in the age of COVID 17:4...2020-06-2153 min
開放咖啡角EP10_聊聊科學研究的replication推廣愛好科學的人們認識並且討論Replication是開始這個podcast的主要原因。前陣子3/27日推動心理科學開放運動的指標人物Brian Nosek在PLOS Biology發表”What is replication?”評論文章，剛好今年初我與中正大學哲學系陳瑞麟老師在google雲端文件討論他的著作「認知與評價」，提到的科學哲學家對於replication的看法。Norsek的評論與陳老師和我的對談有很高的互文性，因為陳老師不方便進行即席對談，所以這一集我融合兩份文本，分享經過對談及閱讀後，我對Replication的看法，以及在中文語境的溝通建議。
與陳瑞麟老師的完整筆談紀錄請見本集朗讀稿。
本集朗讀稿： https://osf.io/hjnk8/
本集錄音檔： https://osf.io/53kyg/
Nosek, B. A., & Errington, T. M. (2020). What is replication? PLOS Biology, 18(3), e3000691. https://doi.org/10.1371/journal.pbio.3000691
施打卡介苗的國家新冠肺炎死亡率較低的說法來源：https://www.jsatonotes.com/2020/03/if-i-were-north-americaneuropeanaustral.html?m=1
拉卡托斯的科學研究綱領：南華大學「知識、權力與社會」課程講義 http://www.nhu.edu.tw/~sts/class/class_01_4.htm
Credit: 本集封面圖取自英國杜倫大學哲學系教授Thomas Rossetter發表於2019年美國地質學會研討論的簡報。下載網頁：http://www.mantleplumes.org/Lakatos.html2020-04-1111 min
The Joy of xRebecca Goldin and Brian Nosek on Hard Truths in Math and PsychologyThe mathematician Rebecca Goldin and the psychology researcher Brian Nosek speak with host Steven Strogatz about what it’s like to be the bearers of unpopular truths. The post Rebecca Goldin and Brian Nosek on Hard Truths in Math and Psychology first appeared on Quanta Magazine2020-03-2446 min
ReproducibiliTea PodcastEpisode 31 - Class 2 - What even is a replication?Episode 31: Class 2 - What even is a replication?
It’s week 2 of Amy’s “Psychology as a Robust Science” course and we are discussing replications. What are they? Is there a distinction between direct and conceptual replications? Do direct replications actually exist? Tune in to (maybe) find out!
Related papers and links
Open Science Collaboration (2015) Estimating the reproducibility of psychological science
https://science.sciencemag.org/content/349/6251/aac4716
Nosek and Errington (2017) Making sense of replications
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5245957/
Brian Nosek’s Queensland talk Amy mentioned (roughly between 5:00-15:00): https://www.youtube.com/watch?v=wsRmyW8GmJs
Gilbe...2020-03-1725 min
The ORION Open Science PodcastA New Normal: How the Center for Open Science is Changing How Science is DoneEpisode Summary:
In this episode we talk to Dr Brian Nosek about the work of the Center for Open Science. We discuss how to shift expectations of what is the norm is science, preregistration, networks, and the impact of a digital society on scientific practice.
Episode Links:
Center for Open Science
@OSFramework
Brian Nosek
@BrianNosek
2020-02-2050 min
New FrontierBrian Nosek on Open Science & The Replication CrisisBrian Nosek (@BrianNosek) joins Erik Torenberg (@eriktorenberg) and Laura Deming (@laurademing) to open science, the replication crisis, and incentives in scientific research.2020-02-0957 min
Philosophy Talk Starters434: Cognitive BiasMore at www.philosophytalk.org/shows/cognitive-bias.
Aristotle thought that rationality was the faculty that distinguished humans from other animals. However, psychological research shows that our judgments are plagued by systematic, irrational, unconscious errors known as ‘cognitive biases.’ In light of this research, can we really be confident in the superiority of human rationality? How much should we trust our own judgments when we are aware of our susceptibility to bias and error? And does our awareness of these biases obligate us to counter them? John and Ken shed their biases with Brian Nosek from the University of Virginia, co-Founder and...2019-12-1411 min
The Jim Rutt ShowEP12 Brian Nosek – Open Science and ReproducibilityBrian Nosek is Co-Founder and Executive Director of the Center for Open Science (COS) that operates the Open Science Framework. COS is enabling open and reproducible research practices worldwide. Brian is also a Professor in the Department of Psychology at the University of Virginia. He received his Ph.D. from Yale University in 2002.
Brian co-founded Project Implicit, an multi-university collaboration for research and education investigating implicit cognition — thoughts and feelings that occur outside of awareness or control. Brian investigates the gap between values and practices, such as when behavior is influenced by factors other than one's intentions and goals. Research ap...2019-09-121h 19
The Psychology PodcastBrian Nosek || Implicit Bias and Open Scienceoday with have Brian Nosek on the podcast. Nosek is co-Founder and Executive Director of the Center for Open Science (http://cos.io/) that operates the Open Science Framework (http://osf.io/). The Center for Open Science is enabling open and reproducible research practices worldwide. Brian is also a Professor in the Department of Psychology at the University of Virginia. He received his Ph.D. from Yale University in 2002. He co-founded Project Implicit (http://projectimplicit.net/), a multi-university collaboration for research and education investigating implicit cognition–thoughts and feelings that occur outside of awareness or control. Brian investigates the ga...2019-08-011h 03
Circle of WillisBrian NosekWelcome to Circle of Willis!
For this episode I'm sharing a conversation I had a while ago with BRIAN NOSEK, professor of Psychology here, with me, at the University of Virginia, as well as co-Founder and Executive Director of the CENTER FOR OPEN SCIENCE, also here in Charlottesville. Brian earned his PhD at Yale University way back in 2002, only about a year before I first met him here, when I was just a jittery job candidate.
Brian has been in the public eye quite a lot in the past decade or so, not only due...2019-06-131h 01
Circle of WillisPreview: Brian NosekHi Everyone!My conversation with BRIAN NOSEK is coming soon, but it isn't quite ready yet. In this preview we talk about how despite being the most successful endeavor in human history, science can be improved upon, not least through changing how we evaluate the success of individual scientists. Our current incentives might be encouraging us to make scientific “beauty out of mush.” This conversation is priceless. More soon!Jim2019-05-3004 min
The Black GoatDon't Be Told What You Want, Don't Be Told What You NeedWhat if there were no journals? Would academic life be barren and empty, noisy and chaotic, happy and egalitarian, or something else entirely? In this episode we conduct an extended thought experiment about life without journals, in order to probe questions about what journals actually do for us anyway, what are other ways to achieve those things, and how we might overcome the downsides of the current scientific publishing ecosystem. How else could peer review work? How would researchers find information and know what to read? Would we just replace our current heuristics and biases with new ones? Plus: We...2019-05-011h 05
The Black GoatDon't Be Told What You Want, Don't Be Told What You NeedWhat if there were no journals? Would academic life be barren and empty, noisy and chaotic, happy and egalitarian, or something else entirely? In this episode we conduct an extended thought experiment about life without journals, in order to probe questions about what journals actually do for us anyway, what are other ways to achieve those things, and how we might overcome the downsides of the current scientific publishing ecosystem. How else could peer review work? How would researchers find information and know what to read? Would we just replace our current heuristics and biases with new ones? Plus...2019-05-011h 05
The Body of EvidenceInterview - Brian Nosek on Open ScienceJonathan and Chris interview Brian Nosek, a professor of psychology and the co-founder and director of the Center for Open Science. They discuss problems and solutions in modern scientific research, such as committing scientists… to stick to a protocol. Table of contents. 2:00 The culture of science. 4:18 Publications as currency for career advancement. 7:53 What researchers tell each other at the bar. 10:22 Cynicism. 12:48 The solution to climate change (not really). 18:24 The paper is advertising for the research. 22:16 Weaknesses of the peer review process. 23:58...2019-04-2159 min
Idea MachinesMedical (d)Evolution with Dr. Robert McNuttIn this episode I talk to Dr Robert McNutt about medical innovation, medical research and publishing, and patient choice. Robert has been practicing medicine for decades and has published many dozens of medical research papers. He is a former editor of JAMA - the Journal of the American Medical Association. He's created pain care simulation programs, run hospitals, sat on the national board of medical examiners, taught at the university of North Carolina and Wisconsin schools of medicine, and published dozens of articles and several books. On top of all of that he is a practicing oncologist...2019-02-121h 09
You Are Not So Smart147 - The Replication Crisis (rebroadcast)"Science is wrong about everything, but you can trust it more than anything."
That's the assertion of psychologist Brian Nosek, director of the Center for Open Science, who is working to correct what he sees as the temporarily wayward path of psychology.
Currently, psychology is facing what some are calling a replication crisis. Much of the most headline-producing research in the last 20 years isn't standing up to attempts to reproduce its findings. Nosek wants to clean up the processes that have lead to this situation, and in this episode, you'll learn how.
- Show notes at: www.youarenotsosmart.com
...2019-02-1045 min
You Are Not So Smart147 - The Replication Crisis (rebroadcast)"Science is wrong about everything, but you can trust it more than anything."That's the assertion of psychologist Brian Nosek, director of the Center for Open Science, who is working to correct what he sees as the temporarily wayward path of psychology.Currently, psychology is facing what some are calling a replication crisis. Much of the most headline-producing research in the last 20 years isn't standing up to attempts to reproduce its findings. Nosek wants to clean up the processes that have lead to this situation, and in this episode, you'll learn how....2019-02-1045 min
You Are Not So Smart147 - The Replication Crisis (rebroadcast)"Science is wrong about everything, but you can trust it more than anything."
That's the assertion of psychologist Brian Nosek, director of the Center for Open Science, who is working to correct what he sees as the temporarily wayward path of psychology.
Currently, psychology is facing what some are calling a replication crisis. Much of the most headline-producing research in the last 20 years isn't standing up to attempts to reproduce its findings. Nosek wants to clean up the processes that have lead to this situation, and in this episode, you'll learn how.
- Show notes at: www.youarenotsosmart.com
...2019-02-1045 min
Idea MachinesChanging How We Do Science with Brian NosekMy guest this week is Brian Nosek, co-Founder and the Executive Director of the Center for Open Science. Brian is also a professor in the Department of Psychology at the University of Virginia doing research on the gap between values and practices, such as when behavior is influenced by factors other than one's intentions and goals. The topic of this conversation is how incentives in academia lead to problems with how we do science, how we can fix those problems, the center for open science, and how to bring about systemic change in general. Show Notes 2018-12-0858 min
The Accad and Koka Report48. Many Statisticians, Many Answers: The Methodological Factor in the Replication CrisisIn 550 BC, the Greek philosopher Heraclitus famously declared: “No man ever steps in the same river twice, for it’s not the same river and he’s not the same man.” In this episode, we learn from our guest whether scientists can step into the same data pool and obtain the same research results twice.
Brian Nosek is Professor of Psychology at the University of Virginia. He is also the co-founder and Executive Director of the Center for Open Science, an organization dedicated to fostering transparency and collaboration in scientific research.
In 2015, Professor Nosek and his team...2018-12-0500 min
The Accad and Koka ReportEp. 48 Many Statisticians, Many Answers: The Methodological Factor in the Replication CrisisIn 550 BC, the Greek philosopher Heraclitus famously declared: “No man ever steps in the same river twice, for it’s not the same river and he’s not the same man.” In this episode, we learn from our guest whether scientists can step into the same data pool and obtain the same research results twice. Brian Nosek…2018-12-0555 min
AnalysisThe Replication CrisisMany key findings in psychological research are under question, as the results of some of its most well-known experiments – such as the marshmallow effect, ego depletion, stereotype threat and the Zimbardo Stanford Prison Experiment – have proved difficult or impossible to reproduce. This has affected numerous careers and led to bitter recriminations in the academic community. So can the insights of academic psychology be trusted and what are the implications for us all? Featuring contributions from John Bargh, Susan Fiske, John Ioannidis, Brian Nosek, Stephen Reicher, Diederik Stapel and Simine Vazire.
Presenter David Edmonds
Producer Ben Cooper2018-11-1228 minEverything Hertz69: Open science tools (with Brian Nosek)We’re joined by Brian Nosek (Centre for Open Science and University of Virginia) to chat about building technology to make open science easier to implement, and shifting the norms of science to make it more open. We also discuss his recent social sciences replication project in which researchers accurately predicted which studies would replicate.
Here’s what we cover:
What is the Centre for Open Science?
How did Brian go from Psychology professor to the director of tech organisation?
How can researchers use the Open Science Framework (OSF)?
How does OSF remove friction for conducting open...2018-10-0949 min
Science UpdateImplicit BiasBOB HIRSHON (host):
Unsettling research on prejudice. I’m Bob Hirshon and this is Science Update.
20 years ago, researchers created a video game to match faces with words. They found that white players can easily pair white faces with good words and black faces with bad words, but slow way down when trying to pair white faces with bad words and black faces with good ones. Researcher Mahzarin Banaji says that even she and her colleagues Anthony Greenwald and Brian Nosek had this unsettling tendency.
MAHZARIN BANAJI (Harvard):
It put us in...2018-09-1900 min
TatterEpisode 20: The Humean Stain, Part 2ABOUT THIS EPISODE
Implicit bias has been studied by many social psychologists, and one particular measure, the Implicit Association Test (or IAT) has often been used in that research. It has also been used by practitioners, often for purposes of raising participants' awareness of their own biases. And millions have completed IAT's online at the Project Implicit website.
In this episode, I continue a discussion with six people who have all thought about the IAT, with the conversation covering such topics as (a) how well the IAT predicts discriminatory behavior and other behavior, (b) whether it's...2018-07-0956 minThe Science of SuccessSelf Help For Smart People - How You Can Spot Bad Science & Decode Scientific Studies with Dr. Brian NosekIn this episode, we show how you can decode scientific studies and spot bad science by digging deep into the tools and skills you need to be an educated consumer of scientific information. Are you tired of seeing seemingly outrageous studies published in the news, only to see the exact opposite published a week later? What makes scientific research useful and valid? How can you, as a non-scientist, read and understand scientific information in a simple and straightforward way that can help you get closer to the truth - and apply those lessons to your life. We discuss this and...2018-07-0556 min
TatterEpisode 19: The Humean Stain, Part 1On April 12, 2018, Donte Robinson and Rashon Nelson, two African-American men, were arrested for trespassing at a Philadelphia Starbucks. They were waiting for another person to join them for a meeting, when a manager called the police because they hadn't made a purchase. In the face of ensuing controversy, Starbucks closed stores nationwide one afternoon at the end of May in order to hold anti-bias training sessions for employees. As in this case and elsewhere, the topic of implicit racial bias has captured many imaginations.
Implicit bias has been studied by many social psychologists, and one particular measure...2018-07-0258 min
Library Channel (Video)Improving Openness and Innovation in Scholarly Communication with Brian NosekBrian Nosek, co-founder and executive director of the Center for Open Science, outlines the most urgent challenges in achieving a more open science future and how the scholarly communication community can change practices to validate and recognize open research. Nosek, a professor of psychology at the University of Virginia, is presented by the UC San Diego Library. Series: "Library Channel" [Science] [Education] [Show ID: 33455]2018-05-1259 min