Tom and Elliot discuss how AI metrics get used and abused and a paper looking at how to understand things.
Part 1
- How to Understand Things by Nabeel - https://nabeelqu.co/understanding
- Not Overthinking podcast episode that discusses Nabeel's article - https://notoverthinking.com/how-to-understand-things-2/
- Visual image of "Bag of words" and Natural Language Processing -https://twitter.com/nwilliams030/status/1278008507044937728/photo/1
- Decision tree analysis for house prices - I could not find this one, sorry folks
- The Sequences from Less Wrong -https://www.readthesequences.com/Book-I-Map-And-Territory
- Modernist bread - https://modernistcuisineshop.com/products/modernist-bread
Part 2
- Concepts we covered; accuracy, sensitivity, specificity, AUC, prevalence, prior probability, positive predictive value, the negative predictive value
- The Metric Matrix - https://medium.com/swlh/how-to-remember-all-these-classification-concepts-forever-761c065be33
- Ibis -https://en.wikipedia.org/wiki/Ibis
- Bin Chicken - https://www.youtube.com/watch?v=w4dYWhkSbTU Ibis Photo: By JJ Harrison (https://www.jjharrison.com.au/)
- Own work, CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=18800827 ROC Image: By cmglee, MartinThoma - Roc-draft-xkcd-style.svg, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=109730045
00:00 Intro
01:04 What are we drinking
04:47 How to Understand Things
06:44 The smartest people aren't the quickest to answer
09:23 Part 1 - Not Giving Up
13:22 When to go deep on a topic
22:08 Asking Dumb Questions
29:52 Life update post paper
32:31 AI metrics and which ones to use
46:21 Sensitivity and Specificity Mistakes
