An exclusive inside look at GPT-5
How I AI7 Elo 2025

An exclusive inside look at GPT-5

In this episode, I share my hands-on experience with OpenAI’s GPT-5, the company’s new frontier model. As one of the first users outside of OpenAI to test the model, I put GPT-5 head-to-head with GPT-4.1 across real-world product use cases—from writing PRDs to generating code to assisting with visual design work. This is my unfiltered look at what GPT-5 can (and can’t) do—and how it changes the game for builders.


What you’ll learn:

1. How GPT-5 differs from previous models with its engineering-focused approach to problem-solving and tendency to prioritize technical details over business context

2. A comparative analysis of how GPT-5 and GPT-4.1 generate different types of product requirement documents and prototypes for the same prompt

3. Why GPT-5 excels at technical writing, functional requirements, and code generation while potentially skipping important business discovery questions

4. The model’s impressive spatial awareness capabilities when generating images for interior design and other visual tasks

5. Practical considerations for choosing the right model based on your specific use case and audience

6. How GPT-5’s extensive tool-calling behavior and bullet-point communication style reflect its engineering-oriented design

—

Brought to you by ChatPRD—an AI copilot for PMs and their teams: https://www.chatprd.ai/howiai

—

25k giveaway:

 To celebrate 25,000 YouTube followers, we’re doing a giveaway. Win a free year of my favorite AI products, including v0, Replit, Lovable, Bolt, Cursor, and, of course, ChatPRD, by leaving a rating and review on your favorite podcast app and subscribing to the podcast on YouTube. To enter: https://www.howiaipod.com/giveaway

—

Where to find Claire Vo:

ChatPRD: https://www.chatprd.ai/

Website: https://clairevo.com/

LinkedIn: https://www.linkedin.com/in/clairevo/

X: https://x.com/clairevo

—

In this episode, we cover:

(00:00) Introduction to GPT-5

(04:34) Testing GPT-5 in ChatPRD for document generation

(07:10) Comparing GPT-5 and GPT-4.1 on business vs. technical orientation

(11:22) Side-by-side comparison of PRDs generated by both models

(15:23) Where GPT-5 excels: Technical considerations and documentation quality

(17:35) Comparing prototypes generated from different model outputs

(19:57) Testing homepage critique capabilities between models

(23:14) OpenAI’s strengths in API design and developer support

(25:37) GPT-5’s performance as a coding assistant

(27:26) Examining GPT-5 in ChatGPT’s interface

(28:50) Testing GPT-5’s front-end design capabilities

(31:17) Personal use case: bathroom remodel planning

(33:45) Comparing GPT-5 vs. GPT-4 for interior design visualization

(38:10) Summary of key findings and recommendations

—

Tools referenced:

• OpenAI: https://openai.com/

• ChatGPT: https://chat.openai.com/

• Claude: https://claude.ai/

• Gemini: https://gemini.google.com/

• Cursor: https://cursor.sh/

• v0: https://v0.dev/

• Lovable: https://lovable.dev/

• Bolt: https://bolt.com/

• LaunchDarkly AI Configs: https://launchdarkly.com/docs/home/ai-configs

—

Other reference:

• Benjamin Moore paints: https://www.benjaminmoore.com/

—

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email jordan@penname.co.

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(123)

How Figma’s PMs actually use AI every day | Ezra Mechaber (PM, Figma)

How Figma’s PMs actually use AI every day | Ezra Mechaber (PM, Figma)

Ezra Mechaber is a growth product manager at Figma whose goal is to be “lazy in the right places.” When he joined Figma, he found almost no one outside engineering using AI to get real work done, so h...

2 Marras 42min

Grok vs. Dot vs. Muse vs. Claude Duet: which one crushes the competition?

Grok vs. Dot vs. Muse vs. Claude Duet: which one crushes the competition?

I have personal-agent fatigue, so I ran the first How I AI personal-agent benchmark: Grok Bot, Dot, Muse, and Claude Duet across nine real tasks, from a Slack reply and a Sentry bug to a Figma thumbna...

28 Loka 35min

Why Reddit built its own AI prototyping tool | Blair Metcalf

Why Reddit built its own AI prototyping tool | Blair Metcalf

Blair Metcalf is the principal UX engineer at Reddit and the builder of Reddit Proto, the company’s in-house vibe-coding harness. With a design system MCP that maps Reddit’s product language to produc...

26 Loka 29min

Claude Duet is beautiful. I still forgot to use it

Claude Duet is beautiful. I still forgot to use it

Anthropic's new personal agent, Claude Duet, lives on your phone, inherits all your Claude plugins and connectors, and is pitched at small business owners and busy professionals. It's the most polishe...

21 Loka 16min

“Claude cuts my TikTok”: How this creator is scaling video with AI | Brooke Lacey

“Claude cuts my TikTok”: How this creator is scaling video with AI | Brooke Lacey

Brooke Lacey has been making videos since before Facebook had video, and she built a TikTok audience of more than 290,000 by learning to cut short-form videos herself. With over 25 years in tech, she ...

19 Loka 36min

Meta’s new ‘Muse Wonder’ model: good for AI agents, bad for design

Meta’s new ‘Muse Wonder’ model: good for AI agents, bad for design

I put Meta’s new Muse Wonder (and Wonder Full) frontier models through the How I AI bench, which covers nearly 20 tasks across prototyping, agentic workflows, coding, writing, and creative work. I sco...

14 Loka 24min

How Meta designed Muse: an AI agent people actually want to talk to | Alex Cornell (Design Director)

How Meta designed Muse: an AI agent people actually want to talk to | Alex Cornell (Design Director)

Alex Cornell is a design director at Meta, where he leads design on Muse, Meta’s consumer AI agent. He came to the role with a long background in software product design, including time as a founder, ...

12 Loka 37min

How OpenAI uses ChatGPT Sites (live at DevDay!) | Kath Korevec (Product Lead)

How OpenAI uses ChatGPT Sites (live at DevDay!) | Kath Korevec (Product Lead)

Kath Korevec is a member of the Product staff at OpenAI working on Codex, and she spent over a year building and using ChatGPT Sites internally before its public launch. She’s been on the front lines ...

5 Loka 35min