Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Avsnitt(778)

Fighting Global Health Disparities with AI w/ Jon Wang - #426

Fighting Global Health Disparities with AI w/ Jon Wang - #426

Today we’re joined by Jon Wang, a medical student at UCSF, and former Gates Scholar and AI researcher at the Bill and Melinda Gates Foundation. In our conversation with Jon, we explore a few of the d...

9 Nov 202035min

Accessibility and Computer Vision - #425

Accessibility and Computer Vision - #425

Digital imagery is pervasive today. More than a billion images per day are produced and uploaded to social media sites, with many more embedded within websites, apps, digital documents, and eBooks. En...

5 Nov 20201h

NLP for Equity Investing with Frank Zhao - #424

NLP for Equity Investing with Frank Zhao - #424

Today we’re joined by Frank Zhao, Senior Director of Quantamental Research at S&P Global Market Intelligence. In our conversation with Frank, we explore how he came to work at the intersection of ML ...

2 Nov 202044min

The Future of Education and AI with Salman Khan - #423

The Future of Education and AI with Salman Khan - #423

In the final #TWIMLfest Keynote Interview, we’re joined by Salman Khan, Founder of Khan Academy. In our conversation with Sal, we explore the amazing origin story of the academy, and how coronavirus ...

28 Okt 202047min

Why AI Innovation and Social Impact Go Hand in Hand with Milind Tambe - #422

Why AI Innovation and Social Impact Go Hand in Hand with Milind Tambe - #422

In this special #TWIMLfest Keynote episode, we’re joined by Milind Tambe, Director of AI for Social Good at Google Research India, and Director of the Center for Research in Computation and Society (C...

23 Okt 202035min

What's Next for Fast.ai? w/ Jeremy Howard - #421

What's Next for Fast.ai? w/ Jeremy Howard - #421

In this special #TWIMLfest episode of the podcast, we’re joined by Jeremy Howard, Founder of Fast.ai. In our conversation with Jeremy, we discuss his career path, including his journey through the co...

21 Okt 20201h 1min

Feature Stores for MLOps with Mike del Balso - #420

Feature Stores for MLOps with Mike del Balso - #420

Today we’re joined by Mike del Balso, co-Founder and CEO of Tecton.  Mike, who you might remember from our last conversation on the podcast, was a foundational member of the Uber team that created th...

19 Okt 202045min

Exploring Causality and Community with Suzana Ilić - #419

Exploring Causality and Community with Suzana Ilić - #419

In this special #TWIMLfest episode, we’re joined by Suzana Ilić, a computational linguist at Causaly and founder of Machine Learning Tokyo (MLT). Suzana joined us as a keynote speaker to discuss the ...

16 Okt 202054min

Populärt inom Politik & nyheter

p3-krim
svenska-fall
rss-krimstad
flashback-forever
motiv
rss-viva-fotboll
spar
rss-sanning-konsekvens
aftonbladet-daily
aftonbladet-krim
rss-krimreportrarna
olyckan-inifran
rss-frandfors-horna
rss-vad-fan-hande
fordomspodden
dagens-eko
rss-flodet
politiken
svd-ledarredaktionen
blenda-2