Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Episoder(779)

Neural Network Quantization and Compression with Tijmen Blankevoort - TWIML Talk #292

Neural Network Quantization and Compression with Tijmen Blankevoort - TWIML Talk #292

Today we’re joined by Tijmen Blankevoort, a staff engineer at Qualcomm, who leads their compression and quantization research teams. In our conversation with Tijmen we discuss:  • The ins and outs of...

19 Aug 201950min

Identifying New Materials with NLP with Anubhav Jain - TWIML Talk #291

Identifying New Materials with NLP with Anubhav Jain - TWIML Talk #291

Today we are joined by Anubhav Jain, Staff Scientist & Chemist at Lawrence Berkeley National Lab. We discuss his latest paper, ‘Unsupervised word embeddings capture latent knowledge from materials sci...

15 Aug 201939min

The Problem with Black Boxes with Cynthia Rudin - TWIML Talk #290

The Problem with Black Boxes with Cynthia Rudin - TWIML Talk #290

Today we are joined by Cynthia Rudin, Professor of Computer Science, Electrical and Computer Engineering, and Statistical Science at Duke University. In this episode we discuss her paper, ‘Please Stop...

14 Aug 201948min

Human-Robot Interaction and Empathy with Kate Darling - TWIML Talk #289

Human-Robot Interaction and Empathy with Kate Darling - TWIML Talk #289

Today we’re joined by Dr. Kate Darling, Research Specialist at the MIT Media Lab. Kate’s focus is on robot ethics, the social implication of how people treat robots and the purposeful design of robots...

8 Aug 201943min

Automated ML for RNA Design with Danny Stoll - TWIML Talk #288

Automated ML for RNA Design with Danny Stoll - TWIML Talk #288

Today we’re joined by Danny Stoll, Research Assistant at the University of Freiburg. Danny’s current research can be encapsulated in his latest paper, ‘Learning to Design RNA’. In this episode, Danny ...

5 Aug 201937min

Developing a brain atlas using deep learning with Theofanis Karayannis - TWIML Talk #287

Developing a brain atlas using deep learning with Theofanis Karayannis - TWIML Talk #287

Today we’re joined by Theofanis Karayannis, Assistant Professor at the Brain Research Institute of the University of Zurich. Theo’s research is focused on brain circuit development and uses Deep Learn...

1 Aug 201937min

Environmental Impact of Large-Scale NLP Model Training with Emma Strubell - TWIML Talk #286

Environmental Impact of Large-Scale NLP Model Training with Emma Strubell - TWIML Talk #286

Today we’re joined by Emma Strubell, currently a visiting scientist at Facebook AI Research. Emma’s focus is bringing state of the art NLP systems to practitioners by developing efficient and robust m...

29 Jul 201937min

“Fairwashing” and the Folly of ML Solutionism with Zachary Lipton - TWIML Talk #285

“Fairwashing” and the Folly of ML Solutionism with Zachary Lipton - TWIML Talk #285

Today we’re joined by Zachary Lipton, Assistant Professor in the Tepper School of Business. With a theme of data interpretation, Zachary’s research is focused on machine learning in healthcare, with t...

25 Jul 20191h 15min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
aftenpodden-usa
forklart
i-retten
popradet
stopp-verden
fotballpodden-2
rss-gukild-johaug
dine-penger-pengeradet
det-store-bildet
nokon-ma-ga
bt-dokumentar-2
hanna-de-heldige
rss-penger-polser-og-politikk
frokostshowet-pa-p5
chit-chat-med-helle
aftenbla-bla
e24-podden
rss-dannet-uten-piano