Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Episoder(778)

Benchmarking ML with MLCommons w/ Peter Mattson - #434

Benchmarking ML with MLCommons w/ Peter Mattson - #434

Today we’re joined by Peter Mattson, General Chair at MLPerf, a Staff Engineer at Google, and President of MLCommons.  In our conversation with Peter, we discuss MLCommons and MLPerf, the former an o...

7 Des 202046min

Deep Learning for NLP: From the Trenches with Charlene Chambliss - #433

Deep Learning for NLP: From the Trenches with Charlene Chambliss - #433

Today we’re joined by Charlene Chambliss, Machine Learning Engineer at Primer AI.  Charlene, who we also had the pleasure of hosting at NLP Office Hours during TWIMLfest, is back to share some of the...

3 Des 202045min

Feature Stores for Accelerating AI Development - #432

Feature Stores for Accelerating AI Development - #432

In this special episode of the podcast, we're joined by Kevin Stumpf, Co-Founder and CTO of Tecton, Willem Pienaar, an engineering lead at Gojek and founder of the Feast Project, and Maxime Beauchemin...

30 Nov 202056min

An Exploration of Coded Bias with Shalini Kantayya, Deb Raji and Meredith Broussard - #431

An Exploration of Coded Bias with Shalini Kantayya, Deb Raji and Meredith Broussard - #431

In this special edition of the podcast, we're joined by Shalini Kantayya, the director of Coded Bias, and Deb Raji and Meredith Broussard, who both contributed to the film. In this panel discussion, ...

27 Nov 20201h 24min

Common Sense as an Algorithmic Framework with Dileep George - #430

Common Sense as an Algorithmic Framework with Dileep George - #430

Today we’re joined by Dileep George, Founder and the CTO of Vicarious. Dileep, who was also a co-founder of Numenta, works at the intersection of AI research and neuroscience, and famously pioneered ...

23 Nov 202047min

Scaling Enterprise ML in 2020: Still Hard! with Sushil Thomas - #429

Scaling Enterprise ML in 2020: Still Hard! with Sushil Thomas - #429

Today we’re joined by Sushil Thomas, VP of Engineering for Machine Learning at Cloudera. Over the summer, I had the pleasure of hosting Sushil and a handful of business leaders across industries at t...

19 Nov 202046min

Enabling Clinical Automation: From Research to Deployment with Devin Singh - #428

Enabling Clinical Automation: From Research to Deployment with Devin Singh - #428

Today we’re joined by Devin Singh, a Physician Lead for Clinical Artificial Intelligence & Machine Learning in Pediatric Emergency Medicine at the Hospital for Sick Children (SickKids) in Toronto, and...

16 Nov 202043min

Pixels to Concepts with Backpropagation w/ Roland Memisevic - #427

Pixels to Concepts with Backpropagation w/ Roland Memisevic - #427

Today we’re joined by Roland Memisevic, return podcast guest and Co-Founder & CEO of Twenty Billion Neurons.  We last spoke to Roland in 2018, and just earlier this year TwentyBN made a sharp pivot t...

12 Nov 202034min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
aftenpodden-usa
forklart
stopp-verden
popradet
det-store-bildet
dine-penger-pengeradet
rss-gukild-johaug
bt-dokumentar-2
lydartikler-fra-aftenposten
hanna-de-heldige
fotballpodden-2
nokon-ma-ga
e24-podden
frokostshowet-pa-p5
aftenbla-bla
rss-ness
rss-penger-polser-og-politikk
rss-dannet-uten-piano