Why Bigger AI Isn't Always Better

Microsoft just unveiled a monster of a machine built for local AI. More memory. More horsepower. More everything.

Which led Rob and Justin to a question that has almost nothing to do with the hardware.

Are we already using more AI than the job actually requires?

This conversation starts with Microsoft's latest announcement but quickly turns into something much bigger. When do you actually need a frontier model? When is a smaller model just as good? And what happens when companies stop optimizing for the smartest AI and start optimizing for the right AI?

It's a familiar pattern. New technology shows up, everyone assumes bigger is better, and eventually we learn that the best solution isn't the most powerful one. It's the one that's powerful enough. AI may be reaching that point faster than anyone expected.

Along the way, Rob and Justin dig into the economics of tokens, why developers should think differently than everyday AI users, and why Microsoft's latest hardware announcement feels like it's missing a piece of the story. They don't pretend to have all the answers. Instead, they do what this podcast does best: pull on an interesting thread until a much better conversation emerges.

If your first instinct has been to reach for the biggest model every time, this episode might convince you that the future belongs to the people who know when not to.

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(237)

The End of All You Can Eat AI

For about two years, we've all been reaching for the biggest hammer on the wall because someone else was paying for the nails. If you were on a subscription, you grabbed the biggest, baddest model on ...

30 Kesä 24min

Waiting Worked...Until AI

For years, Rob had a pretty good system. When a new technology showed up, he didn't immediately declare it the next big thing. He wanted to understand why it mattered first. Sometimes that meant jumpi...

23 Kesä 15min

What Happens After the AI Works?

For the past few years, the conversation around AI has focused on the technology. Which model is best. Which tools to use. How fast everything is changing. But once you start building with it, a diffe...

9 Kesä 35min

Absences, KPI Updates, Book Title and Pre-Order Bundle Reveal

If you've listened to the podcast over the past several months, you've probably heard Rob mention "the book" a few times. Well, it's finally done. In this solo episode, Rob reveals the title, shares t...

2 Kesä 6min

It's Time to Start Looking Into Microsoft IQ

Rob was supposed to be finishing his book. Last chapter. Two days past deadline. Freedom was right there. Instead, he hit pause and recorded this. Because something from a few weeks ago wouldn't leave...

5 Touko 19min

Cowork Builds Apps Now, and 'Acquired Skills Will Appear Here' w/ Garett Medlin

Garett Medlin just got the official title for the job he was already doing: AI Practice Lead at P3. He's also the person responsible for Rob trying Cowork in the first place, despite Rob's very reason...

28 Huhti 56min

AI "versus" the Medical Establishment, Rob's Sith Name, and the Death of Social Media?

Rob didn't go looking for a fight with the medical system. He just showed up with receipts. Claude had already mapped the symptoms, suggested the tests, and summarized the situation better than any po...

21 Huhti 30min