Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Avsnitt(778)

Understanding Cultural Style Trends with Computer Vision w/ Kavita Bala - #410

Understanding Cultural Style Trends with Computer Vision w/ Kavita Bala - #410

Today we’re joined by Kavita Bala, the Dean of Computing and Information Science at Cornell University.  Kavita, whose research explores the overlap of computer vision and computer graphics, joined u...

17 Sep 202038min

That's a VIBE: ML for Human Pose and Shape Estimation with Nikos Athanasiou, Muhammed Kocabas, Michael Black - #409

That's a VIBE: ML for Human Pose and Shape Estimation with Nikos Athanasiou, Muhammed Kocabas, Michael Black - #409

Today we’re joined by Nikos Athanasiou, Muhammed Kocabas, Ph.D. students, and Michael Black, Director of the Max Planck Institute for Intelligent Systems.  We caught up with the group to explore thei...

14 Sep 202043min

3D Deep Learning with PyTorch 3D w/ Georgia Gkioxari - #408

3D Deep Learning with PyTorch 3D w/ Georgia Gkioxari - #408

Today we’re joined by Georgia Gkioxari, a research scientist at Facebook AI Research.  Georgia was hand-picked by the TWIML community to discuss her work on the recently released open-source library ...

10 Sep 202035min

What are the Implications of Algorithmic Thinking? with Michael I. Jordan - #407

What are the Implications of Algorithmic Thinking? with Michael I. Jordan - #407

Today we’re joined by the legendary Michael I. Jordan, Distinguished Professor in the Departments of EECS and Statistics at UC Berkeley.  Michael was gracious enough to connect us all the way from It...

7 Sep 202056min

Beyond Accuracy: Behavioral Testing of NLP Models with Sameer Singh - #406

Beyond Accuracy: Behavioral Testing of NLP Models with Sameer Singh - #406

Today we’re joined by Sameer Singh, an assistant professor in the department of computer science at UC Irvine.  Sameer’s work centers on large-scale and interpretable machine learning applied to info...

3 Sep 202041min

How Machine Learning Powers On-Demand Logistics at Doordash with Gary Ren - #405

How Machine Learning Powers On-Demand Logistics at Doordash with Gary Ren - #405

Today we’re joined by Gary Ren, a machine learning engineer for the logistics team at DoorDash.  In our conversation, we explore how machine learning powers the entire logistics ecosystem. We discuss...

31 Aug 202043min

Machine Learning as a Software Engineering Discipline with Dillon Erb - #404

Machine Learning as a Software Engineering Discipline with Dillon Erb - #404

Today we’re joined by Dillon Erb, Co-founder & CEO of Paperspace. We’ve followed Paperspace since their origins offering GPU-enabled compute resources to data scientists and machine learning develope...

27 Aug 202044min

AI and the Responsible Data Economy with Dawn Song - #403

AI and the Responsible Data Economy with Dawn Song - #403

Today we’re joined by Professor of Computer Science at UC Berkeley, Dawn Song. Dawn’s research is centered at the intersection of AI, deep learning, security, and privacy. She’s currently focused on b...

24 Aug 202053min

Populärt inom Politik & nyheter

p3-krim
svenska-fall
rss-krimstad
flashback-forever
motiv
rss-viva-fotboll
spar
rss-sanning-konsekvens
aftonbladet-daily
aftonbladet-krim
rss-krimreportrarna
olyckan-inifran
rss-frandfors-horna
rss-vad-fan-hande
fordomspodden
dagens-eko
rss-flodet
politiken
svd-ledarredaktionen
blenda-2