Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Avsnitt(779)

Language Modeling and Protein Generation at Salesforce with Richard Socher - #372

Language Modeling and Protein Generation at Salesforce with Richard Socher - #372

Today we’re joined Richard Socher, Chief Scientist and Executive VP at Salesforce. Richard and his team have published quite a few great projects lately, including CTRL: A Conditional Transformer Lang...

4 Maj 202042min

AI Research at JPMorgan Chase with Manuela Veloso - #371

AI Research at JPMorgan Chase with Manuela Veloso - #371

Today we’re joined by Manuela Veloso, Head of AI Research at J.P. Morgan Chase. Since moving from CMU to JP Morgan Chase, Manuela and her team established a set of seven lofty research goals. In this ...

30 Apr 202046min

Panel: Responsible Data Science in the Fight  Against COVID-19 - #370

Panel: Responsible Data Science in the Fight Against COVID-19 - #370

In this discussion, we explore how data scientists and ML/AI practitioners can responsibly contribute to the fight against coronavirus and COVID-19. Four experts: Rex Douglass, Rob Munro, Lea Shanley,...

29 Apr 202058min

Adversarial Examples Are Not Bugs, They Are Features with Aleksander Madry - #369

Adversarial Examples Are Not Bugs, They Are Features with Aleksander Madry - #369

Today we’re joined by Aleksander Madry, Faculty in the MIT EECS Department, to discuss his paper “Adversarial Examples Are Not Bugs, They Are Features.” In our conversation, we talk through what we ex...

27 Apr 202041min

AI for Social Good: Why "Good" isn't Enough with Ben Green - #368

AI for Social Good: Why "Good" isn't Enough with Ben Green - #368

Today we’re joined by Ben Green, PhD Candidate at Harvard and Research Fellow at the AI Now Institute at NYU. Ben’s research is focused on the social and policy impacts of data science, with a focus...

23 Apr 202041min

The Evolution of Evolutionary AI with Risto Miikkulainen - #367

The Evolution of Evolutionary AI with Risto Miikkulainen - #367

Today we’re joined by Risto Miikkulainen, Associate VP of Evolutionary AI at Cognizant AI. Risto joined us back on episode #47 to discuss evolutionary algorithms, and today we get an update on the lat...

20 Apr 202037min

Neural Architecture Search and Google’s New AutoML Zero with Quoc Le - #366

Neural Architecture Search and Google’s New AutoML Zero with Quoc Le - #366

Today we’re super excited to share our recent conversation with Quoc Le, a research scientist at Google. Quoc joins us to discuss his work on Google’s AutoML Zero, semi-supervised learning, and the de...

16 Apr 202054min

Automating Electronic Circuit Design with Deep RL w/ Karim Beguir - #365

Automating Electronic Circuit Design with Deep RL w/ Karim Beguir - #365

Today we’re joined by return guest Karim Beguir, Co-Founder and CEO of InstaDeep. In our conversation, we chat with Karim about InstaDeep’s new offering, DeepPCB, an end-to-end platform for automated ...

13 Apr 202035min

Populärt inom Politik & nyheter

motiv
p3-krim
spar
svenska-fall
flashback-forever
rss-krimstad
rss-viva-fotboll
rss-sanning-konsekvens
aftonbladet-daily
aftonbladet-krim
rss-vad-fan-hande
rss-krimreportrarna
olyckan-inifran
rss-frandfors-horna
fordomspodden
dagens-eko
rss-flodet
svd-ledarredaktionen
politiken
rss-aftonbladet-krim