Inference, Guardrails, and Observability for LLMs with Jonathan Cohen
AI Explained9 Marras 2024

Inference, Guardrails, and Observability for LLMs with Jonathan Cohen

In this episode of AI Explained, we are joined by Jonathan Cohen, VP of Applied Research at NVIDIA.

We will explore the intricacies of NVIDIA's NeMo platform and its components like NeMo Guardrails and NIMS. Jonathan explains how these tools help in deploying and managing AI models with a focus on observability, security, and efficiency. They also explore topics such as the evolving role of AI agents, the importance of guardrails in maintaining responsible AI, and real-world examples of successful AI deployments in enterprises like Amdocs. Listeners will gain insights into NVIDIA's AI strategy and the practical aspects of deploying large language models in various industries.

Jaksot(18)

How to Prevent AI Agents from Going Rogue With David Kenny

How to Prevent AI Agents from Going Rogue With David Kenny

In this episode of AI Explained, we are joined by David Kenny, Executive Chairman of the Board of Nielsen and veteran AI leader.  He discusses how to prevent AI agents from going rogue, sharing insigh...

6 Helmi 51min

Building Agents at Scale: Lessons from the Front Lines With Gary Stafford

Building Agents at Scale: Lessons from the Front Lines With Gary Stafford

In this episode of AI Explained, we are joined by Gary Stafford, Principal Solutions Architect at AWS Strands Agents. He delves into how enterprises choose between AI/ML and agentic approaches, patter...

25 Syys 202558min

Lessons Learned from Building Agentic Systems With Jayeeta Putatunda

Lessons Learned from Building Agentic Systems With Jayeeta Putatunda

In this episode of AI Explained, we are joined by Jayeeta Putatunda, Director of AI Center of Excellence at Fitch Group.  She discusses essential lessons learned from building and deploying AI agent s...

16 Elo 202546min

Agent Wars: The Hype, Hope, and Hidden Risks with Nate B. Jones

Agent Wars: The Hype, Hope, and Hidden Risks with Nate B. Jones

In this episode of AI Explained, we are joined by Nate B. Jones, AI strategist. He explores high-level advice for organizations, technical ideas such as prompting and application architecture, and the...

24 Heinä 202556min

AI Observability and Security for Agentic Workflows with Karthik Bharathy

AI Observability and Security for Agentic Workflows with Karthik Bharathy

In this episode of AI Explained, we are joined by Karthik Bharathy, General Manager, AI Ops & Governance for Amazon SageMaker AI at AWS.  He discusses the critical aspects of AI security and observabi...

20 Maalis 202544min

GenAI Use Cases and Challenges in Healthcare with Dr. Girish Nadkarni

GenAI Use Cases and Challenges in Healthcare with Dr. Girish Nadkarni

In this episode of AI Explained, Dr. Girish Nadkarni from Icahn School of Medicine at Mount Sinai.  He discusses the implementation and impact of AI, specifically generative AI, in healthcare. He cove...

28 Helmi 202539min

GRC in Generative AI with Navrina Singh

GRC in Generative AI with Navrina Singh

In this episode of AI Explained, we are joined by Navrina Singh, Founder and CEO at Credo AI. We will discuss the comprehensive need for AI governance beyond regulated industries, the core principles ...

7 Joulu 202456min