Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Episoder(779)

Machine Learning: A New Approach to Drug Discovery with Daphne Koller - #332

Machine Learning: A New Approach to Drug Discovery with Daphne Koller - #332

Today we’re joined by Daphne Koller, co-Founder and former co-CEO of Coursera and Founder and CEO of Insitro. In our conversation, discuss the current landscape of pharmaceutical drugs and drug discov...

26 Des 201943min

Sensory Prediction Error Signals in the Neocortex with Blake Richards - #331

Sensory Prediction Error Signals in the Neocortex with Blake Richards - #331

Today we continue our 2019 NeurIPS coverage, this time around joined by Blake Richards, Assistant Professor at McGill University and a Core Faculty Member at Mila. Blake was an invited speaker at the ...

24 Des 201940min

How to Know with Celeste Kidd - #330

How to Know with Celeste Kidd - #330

Today we’re joined by Celeste Kidd, Assistant Professor at UC Berkeley, to discuss her invited talk “How to Know” which details her lab’s research about the core cognitive systems people use to guide ...

23 Des 201953min

Using Deep Learning to Predict Wildfires with Feng Yan - #329

Using Deep Learning to Predict Wildfires with Feng Yan - #329

Today we’re joined by Feng Yan, Assistant Professor at the University of Nevada, Reno to discuss ALERTWildfire, a camera-based network infrastructure that captures satellite imagery of wildfires. In o...

20 Des 201951min

Advancing Machine Learning at Capital One with Dave Castillo - #328

Advancing Machine Learning at Capital One with Dave Castillo - #328

Today we’re joined by Dave Castillo, Managing VP for ML at Capital One and head of their Center for Machine Learning. In our conversation, we explore Capital One’s transition from “lab-based” ML to en...

19 Des 201947min

Helping Fish Farmers Feed the World with Deep Learning w/ Bryton Shang - #327

Helping Fish Farmers Feed the World with Deep Learning w/ Bryton Shang - #327

Today we’re joined by Bryton Shang, Founder & CEO at Aquabyte, a company focused on the application of computer vision to various fish farming use cases. In our conversation, we discuss how Bryton ide...

17 Des 201937min

Metaflow, a Human-Centric Framework for Data Science with Ville Tuulos - #326

Metaflow, a Human-Centric Framework for Data Science with Ville Tuulos - #326

Today we kick off our re:Invent 2019 series with Ville Tuulos, Machine Learning Infrastructure Manager at Netflix. At re:Invent, Netflix announced the open-sourcing of Metaflow, their “human-centric f...

13 Des 201956min

Single Headed Attention RNN: Stop Thinking With Your Head with Stephen Merity - #325

Single Headed Attention RNN: Stop Thinking With Your Head with Stephen Merity - #325

Today we’re joined by Stephen Merity, an independent researcher focused on NLP and Deep Learning. In our conversation, we discuss Stephens latest paper, Single Headed Attention RNN: Stop Thinking With...

12 Des 201959min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
aftenpodden-usa
forklart
i-retten
popradet
stopp-verden
det-store-bildet
fotballpodden-2
rss-gukild-johaug
dine-penger-pengeradet
nokon-ma-ga
bt-dokumentar-2
hanna-de-heldige
lydartikler-fra-aftenposten
rss-penger-polser-og-politikk
frokostshowet-pa-p5
aftenbla-bla
rss-dannet-uten-piano
e24-podden