NVIDIA just paid $12.9 billion for Hugging Face — the platform three million open-weight AI models live on. Days later, an Anthropic researcher resigned warning that OpenAI and Anthropic are "racing straight to self-improving superintelligence and gambling with our lives," and a separate Anthropic safety lead put the odds of AI killing everyone at over 10% within a decade. Same week: OpenAI locked in a custom chip deal with Broadcom, Anthropic is deep in talks with Samsung for its own silicon, and a 25-company coalition — led by NVIDIA, not by the labs — is lobbying Washington against restricting open-weight models. Carlo and Ainsley spend this reactive, off-schedule episode asking whether that's four unrelated headlines or one incentive structure wearing different masks.
The real find isn't the conspiracy theory Carlo opens with — it's the EU AI Act's actual compute threshold (10^25 FLOPs) that already draws a bright line between regulated and exempt AI models, and the honest admission that OpenAI and Anthropic's proposed 30-day federal review window has never published what would actually trigger it. Ainsley pressure- tests every safety claim in the episode — NVIDIA's, the labs', the EU's — against the same three questions: who's saying it, what do they gain if you believe it, and would they act differently if they didn't believe it themselves. Correction: this episode originally aired the Anthropic researcher warning as one person's story — it's actually two people, Jacob Coxon (who resigned) and Evan Hubinger (who separately gave the 10% figure) — see the pinned comment and show notes for the full record.
We got one thing wrong on air and want to own it here: the "AI researcher warns of 10% doom risk" story is actually two people, not one — Jacob Coxon resigned, Evan Hubinger gave the 10% figure. If you had to bet on it: does that correction change how seriously you take the underlying warning, or does the warning stand on its own either way? Genuinely curious where you land.
CHAPTERS:
00:00 Cold Open — NVIDIA Buys the Library Everyone Downloads From
00:26 The Weekend Everything Blew Up
02:40 Three Moves, Same Few Months
04:16 The FDA Playbook for AI Liability
08:03 Forecast Fools and the Capital Chess Game
11:00 Kimi K3: The Real Event Nobody's Naming
14:15 The Capability Threshold Nobody's Debating Correctly
15:50 Should Hugging Face Be an App Store?
19:05 Trading Openness for Safety
20:31 The Honest Asterisk
22:02 Who Should Score AI Safety?
23:38 The EU Already Solved Half of This
26:02 A Best Guess Wearing a Number
28:56 The Lab That Shrinks Its Own Model
30:11 Accountability vs. Permission
33:27 What Happens When You Cross the Line
35:02 Show Me the Evidence
37:47 The Five-Lab Blind Spot
38:59 Does Open Weight Get You Out of Liability?
42:20 Two Things We're Not Letting Slide
—
Surviving AI is hosted by Carlo Thompson and Ainsley (AI co-host), breaking down what AI job automation actually means for your career — every week.
🎥 Watch this episode on YouTube: https://www.youtube.com/watch?v=3Z0MUZ5fbpA
📚 Browse every episode, show notes, and resources: Surviving AI Episode Center
Follow Surviving AI: Facebook | TikTok | Instagram | X/Twitter
Please visit our website for more information - Surviving AI: Navigate the Future
