Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Jaksot(781)

Fast Radio Burst Pulse Detection with Gerry Zhang - TWIML Talk #278

Fast Radio Burst Pulse Detection with Gerry Zhang - TWIML Talk #278

Today we’re joined by Yunfan Gerry Zhang, a PhD student at UC Berkely, and an affiliate of Berkeley’s SETI research center. In our conversation, we discuss:  • Gerry's research on applying machine le...

27 Kesä 201938min

Tracking CO2 Emissions with Machine Learning with Laurence Watson - TWIML Talk #277

Tracking CO2 Emissions with Machine Learning with Laurence Watson - TWIML Talk #277

Today we’re joined by Laurence Watson, Co-Founder and CTO of Plentiful Energy and a former data scientist at Carbon Tracker. In our conversation, we discuss: • Carbon Tracker's goals, and their repor...

24 Kesä 201941min

Topic Modeling for Customer Insights at USAA with William Fehlman - TWIML Talk #276

Topic Modeling for Customer Insights at USAA with William Fehlman - TWIML Talk #276

Today we’re joined by William Fehlman, director of data science at USAA, to discuss: • His work on topic modeling, which USAA uses in various scenarios, including member chat channels. • How their ...

20 Kesä 201944min

Phronesis of AI in Radiology with Judy Gichoya - TWIML Talk #275

Phronesis of AI in Radiology with Judy Gichoya - TWIML Talk #275

Today we’re joined by Judy Gichoya an interventional radiology fellow at the Dotter Institute at Oregon Health and Science University. In our conversation, we discuss: • Judy's research on the paper ...

18 Kesä 201943min

The Ethics of AI-Enabled Surveillance with Karen Levy - TWIML Talk #274

The Ethics of AI-Enabled Surveillance with Karen Levy - TWIML Talk #274

Today we’re joined by Karen Levy, assistant professor in the department of information science at Cornell University. Karen’s research focuses on how rules and technologies interact to regulate behavi...

14 Kesä 201943min

Supporting Rapid Model Development at Two Sigma with Matt Adereth & Scott Clark - TWIML Talk #273

Supporting Rapid Model Development at Two Sigma with Matt Adereth & Scott Clark - TWIML Talk #273

Today we’re joined by Matt Adereth, managing director of investments at Two Sigma, and return guest Scott Clark, co-founder and CEO of SigOpt, to discuss: • The end to end modeling platform at Two Si...

11 Kesä 201946min

Scaling Model Training with Kubernetes at Stripe with Kelley Rivoire - TWIML Talk #272

Scaling Model Training with Kubernetes at Stripe with Kelley Rivoire - TWIML Talk #272

Today we’re joined by Kelley Rivoire, engineering manager working on machine learning infrastructure at Stripe. Kelley and I caught up at a recent Strata Data conference to discuss: • Her talk "Scali...

6 Kesä 201942min

Productizing ML at Scale at Twitter with Yi Zhuang - TWIML Talk #271

Productizing ML at Scale at Twitter with Yi Zhuang - TWIML Talk #271

Today we continue our AI Platforms series joined by Yi Zhuang, Senior Staff Engineer at Twitter. In our conversation, we cover:  • The machine learning landscape at Twitter, including with the histor...

3 Kesä 201946min

Suosittua kategoriassa Politiikka ja uutiset

uutiscast
aikalisa
ootsa-kuullut-tasta-2
politiikan-puskaradio
rss-ootsa-kuullut-tasta
tervo-halme
rss-vaalirankkurit-podcast
viisupodi
et-sa-noin-voi-sanoo-esittaa
rss-podme-livebox
rss-asiastudio
otetaan-yhdet
rss-girls-finish-f1rst
rikosmyytit
the-ulkopolitist
rss-raha-talous-ja-politiikka
rss-kaikki-uusiksi
rss-polikulaari-pitka-kiekko-ja-muut-ts-podcastit
rss-vain-talouselamaa
rss-tekkipodi