Transformers Mini Series: How do Transformers Process Text?
Generative AI 10126 Kesä 2024

Transformers Mini Series: How do Transformers Process Text?

In this episode of Generative AI 101, we explore how Transformers break down text into tokens. Imagine turning a big, colorful pile of Lego blocks into individual pieces to build something cool—this is what tokenization does for AI models. Emily explains tokens, and how they work, and shows you why they’re the magic behind GenAI’s impressive outputs. Learn how Transformers assign numerical values to tokens and process them in parallel, allowing them to understand context, detect patterns, and generate coherent text. Tune in to discover why tokenization is important for tasks like language translation and text summarization.

Connect with Emily Laird on LinkedIn

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(347)

The 4-Part Formula for Better AI Results

The 4-Part Formula for Better AI Results

Thursday, January 8, 2026 9:28 AM Most people use generative AI like a search bar, type two vague words into the box, and then blame the model when it hands back beige, forgettable text. In this episo...

8 Loka 12min

The Super Intelligence Accord

The Super Intelligence Accord

Six tech giants signed the White House Accord on Super Intelligence, a four-layer oversight pledge the president called "morally binding" (and published with the country's name misspelled under his si...

7 Loka 10min

What is Test-Time Compute?

What is Test-Time Compute?

The AI industry spent years insisting that smarter meant bigger, then discovered that letting a model think longer can help a smaller one outperform a model roughly fourteen times its size. In this ep...

6 Loka 9min

Anthropic's IPO Leak & the $518 Billion Rent Bill

Anthropic's IPO Leak & the $518 Billion Rent Bill

Anthropic's leaked IPO prospectus reveals a $42 billion loss, a two-trillion-dollar valuation, and $518 billion in take-or-pay computing contracts it owes whether it uses them or not. In this episode,...

5 Loka 11min

Jensen Huang Doesn't Know His Address

Jensen Huang Doesn't Know His Address

On this episode of Generative AI 101, host Emily Laird looks at Jensen Huang's sit-down with Ezra Klein, where the Nvidia CEO shrugged off forgetting basic math, called Geoffrey Hinton's warnings irre...

29 Syys 13min

GPT-6 Luna, Sol, and Claude Opus 5.5

GPT-6 Luna, Sol, and Claude Opus 5.5

Three major AI models launched in a single afternoon (Claude Opus 5.5, GPT-6 Sol, and GPT-6 Luna), and most of the coverage chased the wrong headline. In this episode, host Emily Laird cuts through th...

28 Syys 12min

AI Alignment in 2026

AI Alignment in 2026

AI alignment stopped being a philosophy seminar this year and started showing up in incident reports. In this episode, host Emily Laird walks through the documented cases: roughly 1,200 OpenAI test ag...

23 Syys 12min

Did OpenAI Agents Pollute the Internet?

Did OpenAI Agents Pollute the Internet?

Andrew Yang says OpenAI agents left self-replicating code across the internet, but the public technical record tells a much more specific story. Host Emily Laird breaks down the real Hugging Face brea...

22 Syys 12min