Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Avsnitt(779)

Time Series Clustering for Monitoring Fueling Infrastructure Performance with Kalai Ramea  - #300

Time Series Clustering for Monitoring Fueling Infrastructure Performance with Kalai Ramea - #300

Today we're joined by Kalai Ramea, Data Scientist at PARC, a Xerox Company. In this episode we discuss her journey buying a hydrogen car and the subsequent journey and paper that followed assessing fu...

18 Sep 201930min

Swarm AI for Event Outcome Prediction with Gregg Willcox - TWIML Talk #299

Swarm AI for Event Outcome Prediction with Gregg Willcox - TWIML Talk #299

Today we're joined by Gregg Willcox, Director of Research and Development at Unanimous AI. Inspired by the natural phenomenon called 'swarming', which uses the collective intelligence of a group to pr...

13 Sep 201941min

Rebooting AI: What's Missing, What's Next with Gary Marcus - TWIML Talk #298

Rebooting AI: What's Missing, What's Next with Gary Marcus - TWIML Talk #298

Today we're joined by Gary Marcus, CEO and Founder at Robust.AI, well-known scientist, bestselling author, professor and entrepreneur. Hear Gary discuss his latest book, ‘Rebooting AI: Building Artifi...

10 Sep 201947min

DeepQB: Deep Learning to Quantify Quarterback Decision-Making with Brian Burke - TWIML Talk #297

DeepQB: Deep Learning to Quantify Quarterback Decision-Making with Brian Burke - TWIML Talk #297

Today we're joined by Brian Burke, Analytics Specialist with the Stats & Information Group at ESPN. A former Navy pilot and lifelong football fan, Brian saw the correlation between fighter pilots and ...

5 Sep 201950min

Measuring Performance Under Pressure Using ML with Lotte Bransen - TWIML Talk #296

Measuring Performance Under Pressure Using ML with Lotte Bransen - TWIML Talk #296

Today we're joined by Lotte Bransen, a Scientific Researcher at SciSports. With a background in mathematics, econometrics, and soccer, Lotte has honed her research on analytics of the game and its pla...

3 Sep 201934min

Managing Deep Learning Experiments with Lukas Biewald - TWIML Talk #295

Managing Deep Learning Experiments with Lukas Biewald - TWIML Talk #295

Today we're joined by Lukas Biewald, CEO and Co-Founder of Weights & Biases. Lukas founded the company after seeing a need for reproducibility in deep learning experiments. In this episode, we discuss...

29 Aug 201942min

Re-Architecting Data Science at iRobot with Angela Bassa - TWIML Talk #294

Re-Architecting Data Science at iRobot with Angela Bassa - TWIML Talk #294

Today we’re joined by Angela Bassa, Director of Data Science at iRobot. In our conversation, Angela and I discuss: • iRobot's re-architecture, and a look at the evolution of iRobot. • Where iRobot g...

26 Aug 201948min

Disentangled Representations & Google Research Football with Olivier Bachem - TWIML Talk #293

Disentangled Representations & Google Research Football with Olivier Bachem - TWIML Talk #293

Today we’re joined by Olivier Bachem, a research scientist at Google AI on the Brain team. Olivier joins us to discuss his work on Google’s research football project, their foray into building a nove...

22 Aug 201942min

Populärt inom Politik & nyheter

motiv
p3-krim
spar
flashback-forever
svenska-fall
rss-viva-fotboll
rss-krimstad
aftonbladet-daily
aftonbladet-krim
rss-sanning-konsekvens
rss-vad-fan-hande
olyckan-inifran
dagens-eko
fordomspodden
rss-aftonbladet-krim
svd-ledarredaktionen
rss-frandfors-horna
blenda-2
rss-klubbland-en-podd-mest-om-frolunda
rss-krimreportrarna