Episode 3 - Questionable Research Practices
This week we discuss the prevalence of questionable research practices in John, Lowenstein, & Prelec “Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling” http://journals.sagepub.com/doi/abs/10.1177/0956797611430953
Highlights:
[2:00] What are questionable research practices?
[3:00] QRP as a political term
[6:00] a pinch of transparency
[8:00] QRPs as a grey area?
[12:00] Does defining a QRP as ‘just’ questionable water down the message of ‘this is wrong’?
[14:00] Do John, Lowenstein, & Prelec practice what they preach in this paper? We discuss the methodology
[19:30] Figure 1 - What do we see? “Everybody’s doing it”
[22:00] Passing on QRPs throughout the (research) generations
[24:30] Defending QRPs
[28:00] What would the QRP rates look like now?
[29:30] You can't round down p values to be less than .05, stop cheating
[30:30] Figure 2 - “I’m fine and so are my collaborators, its other people that I doubt…”
[33:00] Our job is to be critical. We get sad about the pushback to being critical on QRPs
[35:00] Sam tries desperately to find a silver lining, Sophia advocates arson.
