The Stack Overflow Podcast2 Apr 2024

Are long context windows the end of RAG?

DBRX, an open, general-purpose LLM created by Databricks, reportedly outperforms GPT-3.5 and is competitive with Gemini 1.0 Pro.

Recent research found that large, complex LLMs use a simple mechanism to retrieve stored knowledge in response to a user prompt. These mechanisms can help researchers reveal what the model knows and potentially even correct false information it has stored.

FTX co-founder Sam Bankman-Fried, whose downfall began in late 2022, was sentenced last week to 25 years in prison for conspiracy and fraud.

Find Michael on LinkedIn.

Find Cassidy on her website.

Stack Overflow user Bucket received a well-deserved Lifeboat badge for rescuing How to calculate decimal(x, y) max value in SQL Server from an ocean of ignorance.

Chapters (please note that these timestamps may not be exact):

00:00 Introduction and White Paper Discussion

02:01 Long Context Windows and Retrieval Augmented Generation

05:56 Models' Ability to Recall Relevant Information

07:18 Models' Creativity and Thinking Outside the Box

09:41 Advantages and Limitations of Models' Knowledge

15:09 Databricks' Open Language Model

22:25 Sam Bankman-Fried’s Sentence and the Effects on Crypto/Blockchain

31:28 Closing Remarks and Lifeboat Badge

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(995)

Rumors of the SaaS demise are greatly exaggerated

Recorded on the floor of LDX3, Ryan chats with Nivia Henry, an engineering leader most recently at Netflix, about the reality of the supposed SaaS apocalypse, the complex calculus of the modern build-...

23 Okt 25min

Don't forget about the UI for AI

Recorded at OpenAI Dev Day 2026, Ryan sits down with Andrew Ambrosino, member of the technical staff at OpenAI, for a conversation on OpenAI's strategy for merging ChatGPT and Codex into a unified exp...

20 Okt 24min

AI says you’re right, formal methods say you’re wrong

Ryan is joined by Gabriela Moreira, CEO at Quint, about why formal specification languages like TLA+ are essential for catching system design flaws before writing code, how Quint brings developer-frie...

16 Okt 28min

Keep calm and call clone with Rust

Ryan sits down with Josh Triplett, member of the Rust Leadership Team at the Rust Project, to chat about how the borrow checker delivers compile-time memory safety without garbage collection overhead,...

13 Okt 43min

Taking a look under your agent’s hood

Ryan is joined by Yanbing Li, Chief Product Officer at Datadog, to talk about applying observability to non-deterministic AI agents, blurring the boundaries between software development and production...

9 Okt 33min

Tales from the 2026 Developer Survey results

Ryan chats with Erin Yepis, Senior Analyst at Stack Overflow, about the results from this year’s Annual Developer Survey, including the overwhelming daily usage of AI coding assistants despite lingeri...

6 Okt 32min

Constraints that make developers faster

Ryan chats with Julien Verlaguet, CEO at Skip Labs, about finding the balance between human tolerance and tooling constraints, the spectrum of typed programming languages, and building cost-effective ...

2 Okt 28min

Your phone is AI’s newest hardware

Ryan sits down with Div Garg, CEO at AGI Inc., to talk about running AI agents entirely on mobile devices, optimizing models for edge computing chips, and building safety mechanisms into autonomous ap...

29 Sep 27min