Deep Dive into Long Context

Deep Dive into Long Context

Explore the synergy between long context models and Retrieval Augmented Generation (RAG) in this episode of Release Notes. Join Google DeepMind's Nikolay Savinov as he discusses the importance of large context windows, how they enable Al agents, and what's next in the field.

Chapters:
0:52 Introduction & defining tokens
5:27 Context window importance
9:53 RAG vs. Long Context
14:19 Scaling beyond 2 million tokens
18:41 Long context improvements since 1.5 Pro release
23:26 Difficulty of attending to the whole context
28:37 Evaluating long context: beyond needle-in-a-haystack
33:41 Integrating long context research
34:57 Reasoning and long outputs
40:54 Tips for using long context
48:51 The future of long context: near-perfect recall and cost reduction
54:42 The role of infrastructure
56:15 Long-context and agents

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(31)

Sameer Samat on Android 17 and the Future of Intelligent Computing

Sameer Samat on Android 17 and the Future of Intelligent Computing

Sameer Samat, President of Android at Google, joins host Logan Kilpatrick to discuss Android 17 and what it means to shift from operating systems to intelligence systems. Their conversation covers why...

30 Jun 40min

Yossi Matias on the golden age of research

Yossi Matias on the golden age of research

Yossi Matias, Vice President at Google and Head of Google Research, joins host Logan Kilpatrick for a wide-ranging conversation about what it means to do research at Google scale. Their conversation e...

22 Jun 1h 11min

Gemini co-leads on project origins and what's next

Gemini co-leads on project origins and what's next

To mark the launch of Gemini 3.5 Flash, Logan Kilpatrick sat down at Gradient Canopy with four of the people who built it: Jeff Dean, Koray Kavukcuoglu, Noam Shazeer, and Oriol Vinyals. They talked ab...

22 Jun 41min

Google I/O 2026 Recap with Logan Kilpatrick, Josh Woodward and Tulsee Doshi

Google I/O 2026 Recap with Logan Kilpatrick, Josh Woodward and Tulsee Doshi

Josh Woodward from Google Labs, Gemini and AI Studio and Tulsee Doshi from Google DeepMind join host Logan Kilpatrick to break down the biggest launches from Google I/O 2026, from Gemini 3.5 Flash and...

22 Jun 32min

Google Maps Leaders Talk About Its Biggest Update in 10 Years

Google Maps Leaders Talk About Its Biggest Update in 10 Years

Miriam Daniel and David Cronin join host Logan Kilpatrick to unveil the biggest update in Google Maps history. This episode explores the launch of Ask Maps, a conversational experience powered by Gemi...

12 Mar 36min

Gemini in Workspace: New Ways to Create Faster

Gemini in Workspace: New Ways to Create Faster

Chapters: 1:15 - Gemini in Docs 3:17 - Which models power Workspace 3:45 - AI Overviews in Drive 5:22 - Rollout and availability 6:33 - Reimagining every Workspace canvas 8:58 - Gemini in Calend...

12 Mar 40min

Gemini in Chrome: Your agentic browsing assistant

Gemini in Chrome: Your agentic browsing assistant

Chapters: 0:00 - Introduction 2:49 - Evolution from web apps to integrated assistants 4:37 - Chrome as a platform for personal context 6:38 - Navigating the context overload problem 7:52 - Transf...

12 Mar 48min

Inside Lyria 3, Google's music generation model

Inside Lyria 3, Google's music generation model

1:00 - Defining music generation models1:40 - Lyria as a new instrument3:05 - Connecting language and creative intent5:08 - Guest backgrounds and musical journeys7:57 - Demo: Instrumental funk jam8:29...

18 Feb 36min

Populært innen Vitenskap

fastlegen
tingenes-tilstand
abels-tarn
romkapsel
jss
liberal-halvtime
vett-og-vitenskap-med-gaute-einevoll
rekommandert
villmarksliv
sinnsyn
dekodet-2
fjellsportpodden
rss-rekommandert
rss-overskuddsliv
tomprat-med-gunnar-tjomlid
rss-inn-til-kjernen-med-sunniva-rose
kvinnehelsepodden
diagnose
hva-er-greia-med
rss-paradigmepodden