Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Episoder(779)

Automated Model Tuning with SigOpt - #324

Automated Model Tuning with SigOpt - #324

In this TWIML Democast, we're joined by SigOpt Co-Founder and CEO Scott Clark. Scott details the SigOpt platform, and gives us a live demo! This episode is best consumed by watching the corresponding...

9 Des 201946min

Automated Machine Learning with Erez Barak - #323

Automated Machine Learning with Erez Barak - #323

Today we’re joined by Erez Barak, Partner Group Manager of Azure ML at Microsoft. In our conversation, Erez gives us a full breakdown of his AutoML philosophy, and his take on the AutoML space, its ro...

6 Des 201942min

Responsible AI in Practice with Sarah Bird - #322

Responsible AI in Practice with Sarah Bird - #322

Today we continue our Azure ML at Microsoft Ignite series joined by Sarah Bird, Principal Program Manager at Microsoft. At Ignite, Microsoft released new tools focused on responsible machine learning,...

4 Des 201938min

Enterprise Readiness, MLOps and Lifecycle Management with Jordan Edwards - #321

Enterprise Readiness, MLOps and Lifecycle Management with Jordan Edwards - #321

Today we’re joined by Jordan Edwards, Principal Program Manager for MLOps on Azure ML at Microsoft. In our conversation, Jordan details how Azure ML accelerates model lifecycle management with MLOps, ...

2 Des 201939min

DevOps for ML with Dotscience - #320

DevOps for ML with Dotscience - #320

Today we’re joined by Luke Marsden, Founder and CEO of Dotscience. Luke walks us through the Dotscience platform and their manifesto on DevOps for ML. Thanks to Luke and Dotscience for their sponsors...

26 Nov 201946min

Building an Autonomous Knowledge Graph with Mike Tung - #319

Building an Autonomous Knowledge Graph with Mike Tung - #319

Today we’re joined by Mike Tung, Founder, and CEO of Diffbot. In our conversation, we discuss Diffbot’s Knowledge Graph, including how it differs from more mainstream use cases like Google Search and ...

21 Nov 201944min

The Next Generation of Self-Driving Engineers with Aaron Ma - Talk #318

The Next Generation of Self-Driving Engineers with Aaron Ma - Talk #318

Today we’re joined by our youngest guest ever (by far), Aaron Ma, an 11-year-old middle school student and machine learning engineer in training. Aaron has completed over 80(!) Coursera courses and is...

18 Nov 201947min

Spiking Neural Networks: A Primer with Terrence Sejnowski - #317

Spiking Neural Networks: A Primer with Terrence Sejnowski - #317

On today’s episode, we’re joined by Terrence Sejnowski, to discuss the ins and outs of spiking neural networks, including brain architecture, the relationship between neuroscience and machine learning...

14 Nov 201949min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
aftenpodden-usa
forklart
i-retten
popradet
stopp-verden
det-store-bildet
fotballpodden-2
rss-gukild-johaug
dine-penger-pengeradet
nokon-ma-ga
bt-dokumentar-2
hanna-de-heldige
lydartikler-fra-aftenposten
rss-penger-polser-og-politikk
frokostshowet-pa-p5
aftenbla-bla
rss-dannet-uten-piano
e24-podden