Using LLMs can seem like a safe bet - but they have biases built in at every stage of the process. In this episode, we'll talk about how bias sneaks in and look at some studies that detail how LLMs are trained and how to watch out for and correct bias in an educational context.
Notes:
Follow up on the Tutor CoPilot study from the first week: https://lukeshepard.com/blog/preregistration-of-outcomes
Reserach about LLMs in classrooms: LLMs Are Biased Teachers
Meta's study on A Systematic Study of Bias Amplification
OpenAI discusses their own dataset: OpenAI: Is ChatGPT Biased?
I was influenced by Dr. Timnit Gebru- on AI Bias and the recently published The AI Con Book, which goes into more detail about how bias works in LLMs and the risks across industries.
