Listen

Description

In this episode, Seth and Andrey break down AI and the Quantity and Quality of Creative Products: Have LLMs Boosted Creation of Valuable Books? by Imke Reimers and Joel Waldfogel, presented at the NBER Digital Economics and AI conference. Imke and Joel are a great team of digitization researchers, with particular expertise in Amazon book sales data.The paper uses Amazon data to ask whether AI has increased the number of books being published and whether those books are better or worse.

A hypothesis of the article is that heavily AI-assisted books may have low average quality, but are so easy to produce that you get lots of ‘shots on goal’ for an outlier good book. A few good valueable books are added in addition to masses of slop. But if you assume free disposal on slop, you would accept this as a positive exchange.

Does their data change our views on this topic? We’ll read to find out, and along the way bring in Borges’ Library of Babel, the economics of free disposal, preferential attachment models, and the digitization-of-music literature.

Priors

Hypothesis 1: Has AI increased the number of books released from 2022 to 2025?

* Andrey’s View:

* Prior: Yes, by about 50%. The fall in the cost of writing a book has been so great that the number must have gone up. Analogous to how students are producing far more written work with AI assistance.

* Key caveat: The definition of “book” matters enormously — from a major publisher release to a random PDF online. The looser the definition, the bigger the number.

* Seth’s View:

* Prior: Yes, by about 3x. To the extent that slop gets dumped on the market and is allowed in, a dramatic increase is inevitable. Though he acknowledges it’s still an empirical question — AI also lowered the cost of everything else, including Substack.

Hypothesis 2: Has AI increased the average quality of books released?

* Andrey’s View:

* Prior: Average quality goes down. ~1% chance it goes up. The slop influx is substantial. Imagine a science fiction author with one semi-popular book who now milks it into a series of increasingly sloppy sequels — that author exists and AI just gave them a turbo boost.

* Seth’s View:

* Prior: Average quality goes down. ~10% chance it goes up. He raises the “free disposal” argument — authors who would have written anyway only use AI if it makes the book better, which is a force pushing quality up. But the slop influx probably wins. He remains unwilling to put the probability at zero: “Maybe we’re making some real gems here.”

Hypothesis 3 (The Thinker): By 2030, will total social surplus from book reading by humans be higher or lower because of AI?

* Andrey’s View:

* Prior: 25% chance it goes up. People are reading fewer books over time regardless of AI. Nonfiction manuals and textbooks have a clear substitute in ChatGPT. The form factor of the book seems to be on a secular decline, and new AI-generated books won’t be so good as to reverse that trend.

* Seth’s View:

* Prior: 75% chance it goes up. LLMs may be complements to reading rather than substitutes — he cites using an LLM to track character names while reading Dostoevsky’s Demons as a present-day example. Good books are a complement to everything else in the economy. If AI makes context and curated knowledge more valuable, books have a real role in the 5-to-10-year time horizon. “I don’t care if my job gets automated because I’ll just move to the woods and read books” — Tyler Cowen, representative of no one but Seth.

Links + Shownotes

* AI and the Quantity and Quality of Creative Products: Have LLMs Boosted Creation of Valuable Books? – The central paper of the episode by Imke Reimers and Joel Waldfogel (NBER, 2025).

* Can an AI Interview You Better Than a Human? – Recent Justified Posteriors episode referenced during the discussion.

* BookStat – The independent data provider the authors use to calibrate ratings-to-sales conversions for Amazon books.

Scholars Mentioned

* Imke Reimers – Co-author of the paper; Associate Professor of Economics at Cornell University.

* Joel Waldfogel – Co-author of the paper; Frederick R. Kappel Chair in Applied Economics at the University of Minnesota Carlson School of Management. Previously co-authored the digitization-and-music paper referenced in the episode.

* Tyler Cowen – Economist quoted on the idea of moving to the woods to read books once automation arrives, and on the question of whether you really want to read the 100th automatically generated biography about an imaginary person. Everyone on the internet is saying how they love him this week, so we’ll join in — we love this guy, and have had the honor and exhilaration of being personally encouraged by him.

* Jorge Luis Borges – Author of The Library of Babel, invoked by Seth to frame the question of what a “book” even is — and whether every possible book has, in some sense, already been written.

* Nicholas Decker — Economist as Reporter – A Substack post about economists being more like journalists in the modern era, cited approvingly in the posteriors section.

* Frank Herbert – Author of the Dune series; his sons’ continuations offered up (by Seth) as exhibit A in the case for sequelitis-as-slop.

* Brandon Sanderson – Fantasy author; Andrey volunteers his later-series books as a possible example of quality decline, before declining to name specific titles.

Connections

* The Library of Babel – Borges’ short story imagining a library containing every possible 300-page permutation of the alphabet. Seth invokes it to ask: if AI can generate any text, what does “a new book” even mean?

* The Barnes Foundation – Seth closes with a defense of collage-as-art, citing Albert Barnes’ idiosyncratic collection of Impressionists, Post-Impressionists, and rusty keys as a model for the authorial value in curation and juxtaposition — even if you didn’t write every word.

Discord Community Link: https://discord.gg/KCJwgkTj Justified Posteriors Podcast Transcript

“AI and the Quantity and Quality of Creative Products: Have LLMs Boosted Creation of Valuable Books?”

Hosts: Seth Benzell & Andrey Fradkin

SETH: Welcome to the Justified Posteriors Podcast, the podcast that updates its beliefs about the economics of AI and technology. I’m Seth Benzell, racing against the machine for authorial glory before AI transcends all human writers. Coming to you from Chapman University in sunny Southern California.

ANDREY: And I’m Andrey Fradkin, looking forward to SLOP detection technologies all across all my media surfaces, coming to you from San Francisco, California.

SETH: Andrey, how’s it going, man? It’s been a while since we’ve done a paper episode.

ANDREY: I know, I know. It’s great to actually get back to our core of reading and analyzing a paper. And it’s a particularly fun day to be thinking big exuberant thoughts about the quality of society improving because it’s Mardi Gras. We’re recording this on Fat Tuesday. I’ve got my James Carville shirt on, I’ve got my Mardi Gras beads. Are you doing anything special for Mardi Gras this year?

SETH: You know, Mardi Gras is not my religious holiday, but I am flying to Austin for a fun adventure there. But for me, my sort of Mardi Gras actually happened last week, which was the NBER Digital Economics and AI conference.

ANDREY: What a transition. So what parades and what crews were present at that conference?

SETH: Well, we had the structural crew, we had the reduced form crew. We had the economists and then the business school professors.

ANDREY: No macroeconomists. My macro paper was —

SETH: No, no, no. There was one macro paper, one macro paper allowed.

ANDREY: We allow one. Amazing. Any sort of themes jump out at you from the conference?

SETH: Yeah. I think half the papers were AI papers, which I think is more than we’ve had in the past. Digital economics really started as a group thinking about the internet and the spread of the internet. And AI has until this point not been the dominant theme in the group, but it obviously is becoming so. And of course, there was a lot of discussion about what the future of research will look l…



Get full access to Justified Posteriors at empiricrafting.substack.com/subscribe