Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Avsnitt(779)

Automated Model Tuning with SigOpt - #324

Automated Model Tuning with SigOpt - #324

In this TWIML Democast, we're joined by SigOpt Co-Founder and CEO Scott Clark. Scott details the SigOpt platform, and gives us a live demo! This episode is best consumed by watching the corresponding...

9 Dec 201946min

Automated Machine Learning with Erez Barak - #323

Automated Machine Learning with Erez Barak - #323

Today we’re joined by Erez Barak, Partner Group Manager of Azure ML at Microsoft. In our conversation, Erez gives us a full breakdown of his AutoML philosophy, and his take on the AutoML space, its ro...

6 Dec 201942min

Responsible AI in Practice with Sarah Bird - #322

Responsible AI in Practice with Sarah Bird - #322

Today we continue our Azure ML at Microsoft Ignite series joined by Sarah Bird, Principal Program Manager at Microsoft. At Ignite, Microsoft released new tools focused on responsible machine learning,...

4 Dec 201938min

Enterprise Readiness, MLOps and Lifecycle Management with Jordan Edwards - #321

Enterprise Readiness, MLOps and Lifecycle Management with Jordan Edwards - #321

Today we’re joined by Jordan Edwards, Principal Program Manager for MLOps on Azure ML at Microsoft. In our conversation, Jordan details how Azure ML accelerates model lifecycle management with MLOps, ...

2 Dec 201939min

DevOps for ML with Dotscience - #320

DevOps for ML with Dotscience - #320

Today we’re joined by Luke Marsden, Founder and CEO of Dotscience. Luke walks us through the Dotscience platform and their manifesto on DevOps for ML. Thanks to Luke and Dotscience for their sponsors...

26 Nov 201946min

Building an Autonomous Knowledge Graph with Mike Tung - #319

Building an Autonomous Knowledge Graph with Mike Tung - #319

Today we’re joined by Mike Tung, Founder, and CEO of Diffbot. In our conversation, we discuss Diffbot’s Knowledge Graph, including how it differs from more mainstream use cases like Google Search and ...

21 Nov 201944min

The Next Generation of Self-Driving Engineers with Aaron Ma - Talk #318

The Next Generation of Self-Driving Engineers with Aaron Ma - Talk #318

Today we’re joined by our youngest guest ever (by far), Aaron Ma, an 11-year-old middle school student and machine learning engineer in training. Aaron has completed over 80(!) Coursera courses and is...

18 Nov 201947min

Spiking Neural Networks: A Primer with Terrence Sejnowski - #317

Spiking Neural Networks: A Primer with Terrence Sejnowski - #317

On today’s episode, we’re joined by Terrence Sejnowski, to discuss the ins and outs of spiking neural networks, including brain architecture, the relationship between neuroscience and machine learning...

14 Nov 201949min

Populärt inom Politik & nyheter

motiv
p3-krim
spar
flashback-forever
svenska-fall
rss-krimstad
rss-viva-fotboll
aftonbladet-daily
aftonbladet-krim
rss-sanning-konsekvens
rss-vad-fan-hande
olyckan-inifran
fordomspodden
dagens-eko
rss-frandfors-horna
svd-ledarredaktionen
rss-krimreportrarna
rss-aftonbladet-krim
blenda-2
politiken