In this episode I break down what NVIDIA is, why its GPUs (hint: these are the “chips” you hear so much about) became the backbone of the modern AI boom, and how CUDA locked in its dominance. The conversation moves from gaming history to trillion-dollar valuations and data centers stacked with H100s, offering a clear picture of why nearly every major AI system runs on NVIDIA hardware.
Main Topics Covered
- What NVIDIA is
- NVIDIA’s role in the AI economy
- Founding story and naming
- Early GPUs and the GeForce 256
- Researchers linking GPU math to AI math
- CUDA and the 2012 AlexNet breakthrough
- NVIDIA vs Google TPUs
- H100 chips and DGX Systems
- CUDA lock-In and why NVIDIA likely won’t be dethroned
- Recent ChatGPT use: Chris McCausland using AI to describe images
Links & Resources for This Episode
