Beyond Transcripts: Language Nuances and Audio Signals with Carter Huffman of Modulate

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub talk with Carter Huffman, CTO and co-founder of Modulate AI, about his path from machine learning work at NASA's Jet Propulsion Lab to building voice AI that understands conversations. Carter explains why moderation in gaming is hard because you don't want to ban players unfairly, and contrasts big foundation models with orchestrated ensembles of many tiny models that require high-quality, globally vetted data labeling. They discuss the nuance of classifying hate speech, expansion into detecting fraud and manipulation in delivery and call-center contexts, and monitoring misbehaving AI voice agents. The conversation covers why conversation is more than transcripts, possible therapeutic/telehealth uses of Modulate, analyzing data at a massive scale, and ambitions for audio generation using hierarchical edge-and-cloud approaches. The episode ends with a humorous anecdote about two factor authenticaiton failure. 00:00 Podcast Cold Open 00:48 Meet Carter Huffman 02:06 JPL Spacecraft Autonomy 04:18 From JPL to Audio AI 06:18 Why Audio Is Hard 07:44 Voice AI Use Cases 12:49 Tiny Models Orchestration 15:56 Data Labeling at Scale 17:17 Defining Toxic Behavior 18:58 Nuanced Language Moderation 20:04 Scaling Ensemble Models 21:39 GPU Crunch During Launch 22:29 Beyond Gaming Use Cases 26:03 AI Agents Gone Wrong 28:45 Telehealth and Diagnostics 30:26 Ambient Audio and Privacy 32:26 Edge Ensembles Everywhere 33:25 Audio Synthesis Ambitions 35:24 Latency Hierarchies Explained 38:10 Two Factor Key Fob Fiasco 39:14 Wrap Up and Credits

Resources:

How Many CTOs Pod: https://howmanyctospod.com
Scott Porad: https://www.linkedin.com/in/scottporad/
Brad Hefta-Gaub: https://www.linkedin.com/in/bradheftagaub/
Carter Huffman: https://www.linkedin.com/in/carter-huffman-a9aba05b/
Modulate: https://www.modulate.ai/

#TechPodcast #EngineeringPodcast #DevTalks #PodcastForDevs #HowManyCTOs #Podcast #CTOs #CTOPodcast #ChiefTechnologyOfficer #Technology #Engineering #SoftwareDevelopment #SoftwareEngineering #TechLeadership #EngineeringLeadership #EngineeringCulture #TechDebates #AI #VoiceTech #MachineLearning #MachineLearningModels #GamingIndustry #AIinnovation #Entrepreneurship #AIConversation #VoiceAssistant #LanguageModeration #GPU #LLMs #LargeLanguageModels

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(94)

What Broke in Tech: Code Quality, AI Guardrails, and the Evolving Software Engineer

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub continue to recap Gergely Orosz's "State of the Tech Industry" talk and focus on what "broke" and "what'...

3 Nov 36min

The State of Tech in 2026: What Changed And What Didn't

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub discuss a Pragmatic Engineer talk on the state of the tech industry in 2026, focusing on what changed an...

27 Okt 32min

The Human Needs in Augmented Coding: A Conversation with Kent Beck

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub interview software pioneer Kent Beck about his background (JUnit, test-driven development, extreme progr...

20 Okt 1h 9min

Preparing for the Worst: Tabletop Exercises, Unit Tests, and Everything In Between

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub discuss TaskRabbit's overnight AWS region migration from us-west-1 to us-west-2, describing the months o...

13 Okt 44min

Understanding The Fear: Adaptive Leadership in the AI Age

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub discuss growing fear about AI among engineers and managers, framing it as an "adaptive moment" requiring...

6 Okt 34min

Simplifying Tech Through Empathy and Understanding with Frank Bravo

In this episode of "How Many CTOs Does It Take?" podcast, host Brad Hefta-Gaub is joined by guest Frank Bravo, a Bay Area technologist who spent 30 years as CTO in local media, helping put a newspaper...

29 Sep 50min

Managing Skepticism: Balancing Tradition and Technology with AI

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub discuss how AI is changing software engineering referencing Kent Beck's idea that AI makes much existing...

22 Sep 49min

From Academia to Industry: Scott Hanson on the Future of AI and Edge Computing

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub interview Scott Hanson, founder and CTO of Ambiq, a company focused on ultra-low-power chips for "intell...

15 Sep 45min