Ep 5: Self-Hosted AI — Jackson Oaks on Killing Tokens

Ep 5: Self-Hosted AI — Jackson Oaks on Killing Tokens

Your token bill is going up 4–8x in the next two years. Meanwhile, there's a profitable AI company running production workloads for SMBs on Mac Minis — eliminating token costs entirely and serving 600–800K API calls a month on a single machine.


This is a guest deep-dive — every 5th episode we drop the segments and go one topic, one expert. This week: Jackson Oaks, founder of Recursion AI and the self-hosted AI platform Courier.


Courier: https://getcourier.ai

Jackson on LinkedIn: https://www.linkedin.com/in/jackson-oaks/


THE CONVERSATION

- The 80/20 of open-source AI — why 80% of businesses have 80% of use cases that don't need frontier models

- Why Apple M-series is the most underrated AI hardware story of the decade (1/10th the cost of NVIDIA, 30–40x more power efficient)

- Real production numbers: 600–800K API calls/month per Mac Studio, flat-rate pricing, the math behind killing token spend

- A Fortune company paid Deloitte $400K for a "GPT wrapper with a RAG database"

- Why MIT found 95% of business AI pilots couldn't measure ROI

- War stories: the infinite hallucination loop that ate 10K requests in a week, and how they built hallucination detection from scratch

- Fine-tuning a 14B model that outperformed GPT-4o on a structured extraction task


HOT TAKES

Matt: Anthropic and OpenAI consolidate within three years — or open-source overtakes both and they shrink dramatically.

Oscar: Every home will run a better Alexa on a Mac Mini powered by open-source models.

Jackson: Better systems with smaller models beat throwing frontier models at unstructured problems.


Hosts: Oscar Gallo (AI Engineer & Entrepreneur) and Matt Wozniak (Builder & Operator).

Guest: Jackson Oaks, Recursion AI / Courier.


New episodes every week. Every 5th episode is a guest deep-dive.

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(26)

AI is getting its own POLICE FORCE??

AI is getting its own POLICE FORCE??

Disconnecting an AI assistant does not make it forget. But how much control can you keep before delegation stops saving time?Oscar Gallo and Matt Wozniak discuss Dots memory, Oscar's first-use reactio...

6 Loka 1h 33min

EP 25: Anthropic’s in Its Mad Scientist Era. I’ve Seen This Zombie Movie Before

EP 25: Anthropic’s in Its Mad Scientist Era. I’ve Seen This Zombie Movie Before

Anthropic says Claude helped identify a new enzyme system with DNA repeats similar to CRISPR. Lab tests have started, but the researchers do not yet know its function. Oscar Gallo and Matt Wozniak dis...

29 Syys 1h 10min

EP 24: The AI Model That Cannot Talk, Plus This Week's Stack Check

EP 24: The AI Model That Cannot Talk, Plus This Week's Stack Check

A ChatGPT inventor built an AI model that cannot write a sentence. TypeSafe AI says that is why software can use it more reliably.Jev returns typed, probabilistic decisions instead of prose. Oscar and...

22 Syys 1h 48min

EP 23: AI isn’t going to kill us

EP 23: AI isn’t going to kill us

Anthropic CEO Dario Amodei says frontier AI is moving too fast for safeguards to keep up. Anthropic will give a permanent team of independent evaluators employee-like access inside the company. Sam Al...

15 Syys 1h 11min

EP 22: The Model Is No Longer the Moat. So What Wins Now?

EP 22: The Model Is No Longer the Moat. So What Wins Now?

Today's models can already handle most bounded digital tasks. Oscar argues that model access is no longer a durable moat. The advantage now sits in the task-specific harness: context, task breakdown, ...

8 Syys 1h 20min

EP 21: Frontier AI WITHOUT Nvidia, Ox Alpha was Chinese all along

EP 21: Frontier AI WITHOUT Nvidia, Ox Alpha was Chinese all along

Ox Alpha was GLM-5.3-Flash, and Z.ai says all of its anonymous public traffic ran on Chinese AI chips.Oscar Gallo and Matt Wozniak ask what this changes for Nvidia, model builders, and anyone paying f...

1 Syys 1h 25min

EP 20: A Mysterious AI Model Just Appeared. Nobody Knows Who Built It

EP 20: A Mysterious AI Model Just Appeared. Nobody Knows Who Built It

A free million-token AI model appeared online with no public developer. So who built Ox Alpha, and should you trust it?Oscar Gallo and Matt Wozniak test the claims around the anonymous model now runni...

25 Elo 1h 18min

Ep 19: Opus-Class AI on Your Laptop?

Ep 19: Opus-Class AI on Your Laptop?

Qwen released a 27-billion-parameter model that fits on a well-equipped laptop and beats Claude Opus 4.6 on selected coding benchmarks. Is local AI ready for real company work?Oscar Gallo and Matt Woz...

18 Elo 1h 33min