GPT-5.6 Sol vs. Claude Fable: Why OpenAI’s new model crushes my benchmark
How I AI9 Jul

GPT-5.6 Sol vs. Claude Fable: Why OpenAI’s new model crushes my benchmark

GPT-5.6 Sol is back, and I ran it through my full How I AI vibe benchmark against GPT-5.6 Terra, Luna, Claude Fable 5, and Sonnet 5 across five categories: PRDs, prototypes, wireframes, debugging, and agentic voice. Sol won by a meaningful margin on my Claire Weighted Index (70% my taste, 30% Terminal Bench 2.1), and I also tested two use cases I can't stop thinking about: building a gamified homework tracking app for my kids in one shot with Codex, and browser automation with Chrome that burned through 500 LinkedIn replies while I did literally nothing.


What you’ll learn:

  1. How I scored five AI models (including GPT 5.6 Sol, Fable 5, and Sonnet 5) using my “Claire Weighted Index” benchmark across PRDs, prototypes, code, and agentic voice
  2. The difference between GPT-5.6 Sol (Terra) and Sol for PRD writing
  3. How Fable’s precision and pedantry made it harder to collaborate with, and the exact moment Sol broke through where Fable got stuck
  4. Why Sonnet 5 is still my go-to for agentic voice in OpenClaw, even after this whole benchmark
  5. How I used GPT-5.6 Sol in Codex to build a fully gamified homework tracking app for my kids in one shot
  6. The video editing use case that saved me hours clipping a talk I gave at Cursor’s event
  7. How to use Codex plus GPT-5.6 and Chrome for browser automation, and why this is my single most-loved use case right now

—

In this episode, I cover:

(00:00) Intro

(01:10) The three GPT-5.6 models: Sol, Terra, Luna

(02:17) Pricing: Sol vs. Fable API costs

(03:24) The How I AI benchmark

(05:03) Claire-weighted Index results

(07:00) Per-task winners: prototypes, PRDs, agentic voice

(11:59) What Claire actually rewards

(13:20) Full-fidelity prototype side-by-sides (Sol vs. Fable)

(17:45) Wireframes

(18:19) Agentic voice

(19:15) Where Sol is better than other models

(23:56) Gamified kids’ homework app, built in one shot

(28:02) Fable’s pedantry problem and how Sol broke through it

(31:49) Two bonus use cases: video editing and browser use

(35:08) Final summary and model recommendations

—

Tools referenced:

• GPT 5.6 (Sol, Terra, Luna): https://help.openai.com/en/articles/20001325-a-preview-of-gpt-56-sol-terra-and-luna

• Codex: https://openai.com/codex

• ChatPRD: https://www.chatprd.ai/

• CapCut: https://www.capcut.com/

• Math Academy: https://www.mathacademy.com/

—

Other references:

• Cursor event where Claire spoke on the future of PM: https://www.youtube.com/watch?v=4CAFK-rc26A

• ChatPRD blog (where benchmark outputs will be published): https://www.chatprd.ai/

—

Where to find Claire Vo:

ChatPRD: https://www.chatprd.ai/

Website: https://clairevo.com/

LinkedIn: https://www.linkedin.com/in/clairevo/

X: https://x.com/clairevo

—

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email jordan@penname.co.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(123)

How Figma’s PMs actually use AI every day | Ezra Mechaber (PM, Figma)

How Figma’s PMs actually use AI every day | Ezra Mechaber (PM, Figma)

Ezra Mechaber is a growth product manager at Figma whose goal is to be “lazy in the right places.” When he joined Figma, he found almost no one outside engineering using AI to get real work done, so h...

2 Nov 42min

Grok vs. Dot vs. Muse vs. Claude Duet: which one crushes the competition?

Grok vs. Dot vs. Muse vs. Claude Duet: which one crushes the competition?

I have personal-agent fatigue, so I ran the first How I AI personal-agent benchmark: Grok Bot, Dot, Muse, and Claude Duet across nine real tasks, from a Slack reply and a Sentry bug to a Figma thumbna...

28 Okt 35min

Why Reddit built its own AI prototyping tool | Blair Metcalf

Why Reddit built its own AI prototyping tool | Blair Metcalf

Blair Metcalf is the principal UX engineer at Reddit and the builder of Reddit Proto, the company’s in-house vibe-coding harness. With a design system MCP that maps Reddit’s product language to produc...

26 Okt 29min

Claude Duet is beautiful. I still forgot to use it

Claude Duet is beautiful. I still forgot to use it

Anthropic's new personal agent, Claude Duet, lives on your phone, inherits all your Claude plugins and connectors, and is pitched at small business owners and busy professionals. It's the most polishe...

21 Okt 16min

“Claude cuts my TikTok”: How this creator is scaling video with AI | Brooke Lacey

“Claude cuts my TikTok”: How this creator is scaling video with AI | Brooke Lacey

Brooke Lacey has been making videos since before Facebook had video, and she built a TikTok audience of more than 290,000 by learning to cut short-form videos herself. With over 25 years in tech, she ...

19 Okt 36min

Meta’s new ‘Muse Wonder’ model: good for AI agents, bad for design

Meta’s new ‘Muse Wonder’ model: good for AI agents, bad for design

I put Meta’s new Muse Wonder (and Wonder Full) frontier models through the How I AI bench, which covers nearly 20 tasks across prototyping, agentic workflows, coding, writing, and creative work. I sco...

14 Okt 24min

How Meta designed Muse: an AI agent people actually want to talk to | Alex Cornell (Design Director)

How Meta designed Muse: an AI agent people actually want to talk to | Alex Cornell (Design Director)

Alex Cornell is a design director at Meta, where he leads design on Muse, Meta’s consumer AI agent. He came to the role with a long background in software product design, including time as a founder, ...

12 Okt 37min

How OpenAI uses ChatGPT Sites (live at DevDay!) | Kath Korevec (Product Lead)

How OpenAI uses ChatGPT Sites (live at DevDay!) | Kath Korevec (Product Lead)

Kath Korevec is a member of the Product staff at OpenAI working on Codex, and she spent over a year building and using ChatGPT Sites internally before its public launch. She’s been on the front lines ...

5 Okt 35min

Populært innen Teknologi

lydartikler-fra-aftenposten
teknisk-sett
energi-og-klima
nasjonal-sikkerhetsmyndighet-nsm
teknologi-og-mennesker
rss-snakk-om-sikkerhet
rss-kunstig-intelligens-med-elisabeth-maren-og-morten
shifter
rss-ai-forklart
tomprat-med-gunnar-tjomlid
rss-alt-som-gar-pa-strom
rss-polypod
fornybaren
rss-heis
rss-teknologioptimistene-en-podkast-om-teknologi-og-mennesker
rss-ki-praten
elektropodden
pedagogisk-intelligens
rss-digital-dros
rss-alt-vi-kan