Listen

Description

You can now have o3 throw vastly more compute at a given problem. That's o3-pro.

Should you have o3 throw vastly more compute at a given problem, if you are paying the $200/month subscription price for ChatGPT Pro? Should you pay the $200, or the order of magnitude markup over o3 to use o3-pro in the API?

That's trickier. Sometimes yes. Sometimes no. My experience so far is that waiting a long time is annoying, sufficiently annoying that you often won’t want to wait. Whenever I ask o3-pro something, I often also have been asking o3 and Opus.

Using the API at scale seems prohibitively expensive for what you get, and you can (and should) instead run parallel queries using the chat interface.

The o3-pro answers have so far definitely been better than o3, but the wait is usually enough to break my workflow and [...]

---

Outline:

(03:07) o3-Pro Versus o3

(06:07) Give Me a Minute

(07:33) On Your Marks

(10:04) Reactions

(23:30) Brevity Is The Soul Of Wit

(24:08) Where Art Thou O System Card

(27:05) The Price Drop on o3

---

First published:

June 17th, 2025


Source:

https://www.lesswrong.com/posts/inWQLm6FvFQB68vY7/o3-turns-pro

---

Narrated by TYPE III AUDIO.

---

Images from the article:

A comic comparing two different responses to
Bar graph:
Three bar graphs showing OpenAI reliability benchmarks for different AI models.</p><p>The graphs compare:<br />
1. Competition Math performance<br />
2. PhD Science Questions accuracy<br />
3. Competition Code scores</p><p>Each shows results for o1-pro, o3(medium), and o3-pro models.
Three comparative bar graphs showing OpenAI model performance across evaluation benchmarks.
Performance comparison table showing metrics for various AI language models (2025 versions).</p><p>The table compares global, reasoning, coding, and agentic coding averages across different models including o3 Pro High, Claude 4, and Gemini versions.
Eliezer Yudkowsky tweets:
Cartoon emoji showing shrugging gesture, wearing blue shirt, orange hair.

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.