Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Jaksot(779)

Live from TWIMLcon! Culture & Organization for Effective ML at Scale (Panel) - #308

Live from TWIMLcon! Culture & Organization for Effective ML at Scale (Panel) - #308

TWIMLcon brought together so many in the ML/AI community to discuss the unique challenges to building and scaling machine learning platforms. In this episode, hear about changing the way companies thi...

15 Loka 201927min

Live from TWIMLcon! Use-Case Driven ML Platforms with Franziska Bell - #307

Live from TWIMLcon! Use-Case Driven ML Platforms with Franziska Bell - #307

Today we're Franziska Bell, Ph.D., the Director of Data Science Platforms at Uber, who joined Sam on stage at TWIMLcon last week. Fran provided a look into the cutting edge data science available comp...

10 Loka 201932min

Live from TWIMLcon! Operationalizing ML at Scale with Hussein Mehanna - #306

Live from TWIMLcon! Operationalizing ML at Scale with Hussein Mehanna - #306

The live interviews from TWIMLcon continue with Hussein Mehanna, Head of ML and AI at Cruise. From his start at Facebook to his current work at Cruise, Hussein has seen first hand what it takes to sca...

8 Loka 201933min

Live from TWIMLcon! Encoding Company Culture in Applied AI Systems - #305

Live from TWIMLcon! Encoding Company Culture in Applied AI Systems - #305

In this episode, Sam is joined by Deepak Agarwal, VP of Engineering at LinkedIn, who graced the stage at TWIMLcon: AI Platforms for a keynote interview. Deepak shares the impact that standardizing pro...

4 Loka 201932min

Live from TWIMLcon! Overcoming the Barriers to Deep Learning in Production with Andrew Ng - #304

Live from TWIMLcon! Overcoming the Barriers to Deep Learning in Production with Andrew Ng - #304

Earlier today, Andrew Ng joined us onstage at TWIMLcon - as the Founder and CEO of Landing AI and founding lead of Google Brain, Andrew is no stranger to knowing what it takes for AI and machine learn...

1 Loka 201934min

The Future of Mixed-Autonomy Traffic with Alexandre Bayen - #303

The Future of Mixed-Autonomy Traffic with Alexandre Bayen - #303

Today we are joined by Alexandre Bayen, Director of the Institute for Transportation Studies and Professor at UC Berkeley. Alex's current research is in mixed-autonomy traffic to understand how the gr...

27 Syys 201944min

Deep Reinforcement Learning for Logistics at Instadeep with Karim Beguir - #302

Deep Reinforcement Learning for Logistics at Instadeep with Karim Beguir - #302

Today we are joined by Karim Beguir, Co-Founder and CEO of InstaDeep, a company focusing on building advanced decision-making systems for the enterprise. In this episode, we focus on logistical proble...

25 Syys 201943min

Deep Learning with Structured Data w/ Mark Ryan - #301

Deep Learning with Structured Data w/ Mark Ryan - #301

Today we're joined by Mark Ryan, author of the upcoming book Deep Learning with Structured Data. Working on the support team at IBM Data and AI, he saw a lack of general structured data sets people co...

19 Syys 201939min

Suosittua kategoriassa Politiikka ja uutiset

aikalisa
rss-ootsa-kuullut-tasta
tervo-halme
ootsa-kuullut-tasta-2
politiikan-puskaradio
rss-vaalirankkurit-podcast
viisupodi
rss-podme-livebox
otetaan-yhdet
et-sa-noin-voi-sanoo-esittaa
rss-tasta-on-kyse-ivan-puopolo-verkkouutiset
rss-asiastudio
the-ulkopolitist
mtv-uutiset-polloraati
rss-kaikki-uusiksi
rss-hyvaa-huomenta-bryssel
rss-merja-mahkan-rahat
rss-kuka-mina-olen
rss-raha-talous-ja-politiikka
rss-sanna-ukkola-show-verkkouutiset