Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Jaksot(778)

MOReL: Model-Based Offline Reinforcement Learning with Aravind Rajeswaran - #442

MOReL: Model-Based Offline Reinforcement Learning with Aravind Rajeswaran - #442

Today we close out our NeurIPS series joined by Aravind Rajeswaran, a PhD Student in machine learning and robotics at the University of Washington. At NeurIPS, Aravind presented his paper MOReL: Mode...

28 Joulu 202038min

Machine Learning as a Software Engineering Enterprise with Charles Isbell - #441

Machine Learning as a Software Engineering Enterprise with Charles Isbell - #441

As we continue our NeurIPS 2020 series, we’re joined by friend-of-the-show Charles Isbell, Dean, John P. Imlay, Jr. Chair, and professor at the Georgia Tech College of Computing. This year Charles ga...

23 Joulu 202046min

Natural Graph Networks with Taco Cohen - #440

Natural Graph Networks with Taco Cohen - #440

Today we kick off our NeurIPS 2020 series joined by Taco Cohen, a Machine Learning Researcher at Qualcomm Technologies. In our conversation with Taco, we discuss his current research in equivariant n...

21 Joulu 202058min

Productionizing Time-Series Workloads at Siemens Energy with Edgar Bahilo Rodriguez - #439

Productionizing Time-Series Workloads at Siemens Energy with Edgar Bahilo Rodriguez - #439

Today we close out our re:Invent series joined by Edgar Bahilo Rodriguez, Lead Data Scientist in the industrial applications division of Siemens Energy. Edgar spoke at this year's re:Invent conferenc...

18 Joulu 202041min

ML Feature Store at Intuit with Srivathsan Canchi - #438

ML Feature Store at Intuit with Srivathsan Canchi - #438

Today we continue our re:Invent series with Srivathsan Canchi, Head of Engineering for the Machine Learning Platform team at Intuit.  As we teased earlier this week, one of the major announcements co...

16 Joulu 202041min

re:Invent Roundup 2020 with Swami Sivasubramanian - #437

re:Invent Roundup 2020 with Swami Sivasubramanian - #437

Today we’re kicking off our annual re:invent series joined by Swami Sivasubramanian, VP of Artificial Intelligence, at AWS. During re:Invent last week, Amazon made a ton of announcements on the machi...

14 Joulu 202048min

Predictive Disease Risk Modeling at 23andMe with Subarna Sinha - #436

Predictive Disease Risk Modeling at 23andMe with Subarna Sinha - #436

Today we’re joined by Subarna Sinha, Machine Learning Engineering Leader at 23andMe. 23andMe handles a massive amount of genomic data every year from its core ancestry business but also uses that dat...

11 Joulu 202039min

Scaling Video AI at RTL with Daan Odijk - #435

Scaling Video AI at RTL with Daan Odijk - #435

Today we’re joined by Daan Odijk, Data Science Manager at RTL. In our conversation with Daan, we explore the RTL MLOps journey, and their need to put platform infrastructure in place for ad optimizat...

9 Joulu 202040min

Suosittua kategoriassa Politiikka ja uutiset

aikalisa
tervo-halme
rss-ootsa-kuullut-tasta
ootsa-kuullut-tasta-2
politiikan-puskaradio
viisupodi
rss-vaalirankkurit-podcast
otetaan-yhdet
et-sa-noin-voi-sanoo-esittaa
rss-podme-livebox
io-techin-tekniikkapodcast
linda-maria
rikosmyytit
rss-tasta-on-kyse-ivan-puopolo-verkkouutiset
rss-asiastudio
the-ulkopolitist
rss-uusi-juttu
rss-fi-lainsaadanto-paremmaksi
rss-hyvaa-huomenta-bryssel
rss-50100-podcast