Speculative Decoding and Efficient LLM Inference with Chris Lott - #717
Today, we're joined by Chris Lott, senior director of engineering at Qualcomm AI Research to discuss accelerating large language model inference. We explore the challenges presented by the LLM encodin...
4 Feb 20251h 16min
Ensuring Privacy for Any LLM with Patricia Thaine - #716
Today, we're joined by Patricia Thaine, co-founder and CEO of Private AI to discuss techniques for ensuring privacy, data minimization, and compliance when using 3rd-party large language models (LLMs)...
28 Jan 202551min
AI Engineering Pitfalls with Chip Huyen - #715
Today, we're joined by Chip Huyen, independent researcher and writer to discuss her new book, “AI Engineering.” We dig into the definition of AI engineering, its key differences from traditional machi...
21 Jan 202557min
Evolving MLOps Platforms for Generative AI and Agents with Abhijit Bose - #714
Today, we're joined by Abhijit Bose, head of enterprise AI and ML platforms at Capital One to discuss the evolution of the company’s approach and insights on Generative AI and platform best practices....
13 Jan 202558min
Why Agents Are Stupid & What We Can Do About It with Dan Jeffries - #713
Today, we're joined by Dan Jeffries, founder and CEO of Kentauros AI to discuss the challenges currently faced by those developing advanced AI agents. We dig into how Dan defines agents and distinguis...
16 Dec 20241h 8min
Automated Reasoning to Prevent LLM Hallucination with Byron Cook - #712
Today, we're joined by Byron Cook, VP and distinguished scientist in the Automated Reasoning Group at AWS to dig into the underlying technology behind the newly announced Automated Reasoning Checks fe...
9 Dec 202456min
AI at the Edge: Qualcomm AI Research at NeurIPS 2024 with Arash Behboodi - #711
Today, we're joined by Arash Behboodi, director of engineering at Qualcomm AI Research to discuss the papers and workshops Qualcomm will be presenting at this year’s NeurIPS conference. We dig into th...
3 Dec 202454min
AI for Network Management with Shirley Wu - #710
Today, we're joined by Shirley Wu, senior director of software engineering at Juniper Networks to discuss how machine learning and artificial intelligence are transforming network management. We explo...
19 Nov 202453min
