LessWrong posts by zvi

“AI #138 Part 2: Watch Out For Documents” by Zvi

Listen

Description

As usual when things split, Part 1 is mostly about capabilities, and Part 2 is mostly about a mix of policy and alignment.

Table of Contents

  1. The Quest for Sane Regulations. The GAIN Act and some state bills.
  2. People Really Dislike AI. They would support radical, ill-advised steps.
  3. Chip City. Are we taking care of business?
  4. The Week in Audio. Hinton talks to Jon Stewart, Klein to Yudkowsky.
  5. Rhetorical Innovation. How to lose the moral high ground.
  6. Water Water Everywhere. AI has many big issues. Water isn’t one of them.
  7. Read Jack Clark's Speech From The Curve. It was a sincere, excellent speech.

  8. How One Other Person Responded To This Thoughtful Essay. Some aim to divide.
  9. A Better Way To Disagree. Others aim to work together and make things better.
  10. Voice Versus Exit. The age old [...]

---

Outline:

(00:20) The Quest for Sane Regulations

(05:56) People Really Dislike AI

(12:22) Chip City

(13:12) The Week in Audio

(13:24) Rhetorical Innovation

(20:53) Water Water Everywhere

(23:57) Read Jack Clark's Speech From The Curve

(28:26) How One Other Person Responded To This Thoughtful Essay

(38:43) A Better Way To Disagree

(59:39) Voice Versus Exit

(01:03:51) The Dose Makes The Poison

(01:06:44) Aligning a Smarter Than Human Intelligence is Difficult

(01:10:08) You Get What You Actually Trained For

(01:15:54) Messages From Janusworld

(01:18:37) People Are Worried About AI Killing Everyone

(01:22:40) The Lighter Side

The original text contained 1 footnote which was omitted from this narration.

---

First published:

October 17th, 2025


Source:

https://www.lesswrong.com/posts/gCuJ5DabY9oLNDs9B/ai-138-part-2-watch-out-for-documents

---

Narrated by TYPE III AUDIO.

---

Images from the article:

A businessman in a dark suit and bright red tie sitting at a desk.
A bar graph comparing daily water usage across different industries and activities.
Bar graph showing voter opinions on AI company liability for chatbot outcomes.</p><p>The graph presents three scenarios where voters were asked if AI companies should be held liable when their chatbots give harmful advice, financial advice, or medical advice that fails professional standards. The data shows strong support for company liability across all scenarios.
Bar graph showing water usage by crop types and data centers in America.</p><p>The graph compares daily freshwater consumption in millions of gallons, with alfalfa, orchards, and corn using the most water, while data centers and AI facilities use relatively minimal amounts.
Bar graph:
Bar graph comparing software engineering accuracy scores among different AI models on SWE-bench.
Movie theater marquee with text about slop and great work coexisting, illuminated at night.
News article screenshot from BBC. The headline reads:
Bar graph showing global attitudes toward AI in daily life across 25 countries.</p><p>The visualization presents survey data showing how people from different nations feel about artificial intelligence's increasing presence in everyday life, with responses categorized into
Bar graph showing voter opinions on AI chatbot company liability across demographics</p><p>The chart shows a survey question asking whether companies should be legally liable for harmful AI chatbot advice, with responses broken down by various demographic categories including gender, income, education, and ethnicity. Overall, 78% support company liability.
Bar graph showing trust levels for AI regulation across different regions.</p><p>The chart's title reads:

The visualization compares trust levels between respondents' own countries, EU, US, and China regarding AI regulation effectiveness, with data from Pew Research Center's Spring 2025 Global Attitudes Survey." style="max-width: 100%;" />

Stock Market Nerd tweets:
janus tweets:
Blue file folder with yellow document displaying three items.

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.