Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Jaksot(778)

Decolonizing AI with Shakir Mohamed - #418

Decolonizing AI with Shakir Mohamed - #418

In this special #TWIMLfest edition of the podcast, we’re joined by Shakir Mohamed, a Senior Research Scientist at DeepMind. Shakir is also a leader of Deep Learning Indaba, a non-profit organization ...

14 Loka 202054min

Spatial Analysis for Real-Time Video Processing with Adina Trufinescu

Spatial Analysis for Real-Time Video Processing with Adina Trufinescu

Today we’re joined by Adina Trufinescu, Principal Program Manager at Microsoft, to discuss some of the computer vision updates announced at Ignite 2020.  We focus on the technical innovations that we...

8 Loka 202039min

How Deep Learning has Revolutionized OCR with Cha Zhang - #416

How Deep Learning has Revolutionized OCR with Cha Zhang - #416

Today we’re joined by Cha Zhang, a Partner Engineering Manager at Microsoft Cloud & AI.  Cha’s work at MSFT is focused on exploring ways that new technologies can be applied to optical character reco...

5 Loka 202057min

Machine Learning for Food Delivery at Global Scale - #415

Machine Learning for Food Delivery at Global Scale - #415

In this special edition of the show, we discuss the various ways in which machine learning plays a role in helping businesses overcome their challenges in the food delivery space.  A few weeks ago Sam...

2 Loka 202057min

Open Source at Qualcomm AI Research with Jeff Gehlhaar and Zahra Koochak - #414

Open Source at Qualcomm AI Research with Jeff Gehlhaar and Zahra Koochak - #414

Today we're joined by Jeff Gehlhaar, VP of Technology at Qualcomm, and Zahra Koochak, Staff Machine Learning Engineer at Qualcomm AI Research.  If you haven’t had a chance to listen to our first inte...

30 Syys 202042min

Visualizing Climate Impact with GANs w/ Sasha Luccioni - #413

Visualizing Climate Impact with GANs w/ Sasha Luccioni - #413

Today we’re joined by Sasha Luccioni, a Postdoctoral Researcher at the MILA Institute, and moderator of our upcoming TWIMLfest Panel, ‘Machine Learning in the Fight Against Climate Change.’  We were ...

28 Syys 202041min

ML-Powered Language Learning at Duolingo with Burr Settles - #412

ML-Powered Language Learning at Duolingo with Burr Settles - #412

Today we’re joined by Burr Settles, Research Director at Duolingo. Most would acknowledge that one of the most effective ways to learn is one on one with a tutor, and Duolingo’s main goal is to replic...

24 Syys 202055min

Bridging The Gap Between Machine Learning and the Life Sciences with Artur Yakimovich - #411

Bridging The Gap Between Machine Learning and the Life Sciences with Artur Yakimovich - #411

Today we’re joined by Artur Yakimovich, Co-Founder at Artificial Intelligence for Life Sciences and a visiting scientist in the Lab for Molecular Cell Biology at University College London. In our conv...

21 Syys 202040min

Suosittua kategoriassa Politiikka ja uutiset

aikalisa
tervo-halme
rss-ootsa-kuullut-tasta
ootsa-kuullut-tasta-2
politiikan-puskaradio
viisupodi
rss-vaalirankkurit-podcast
rss-podme-livebox
et-sa-noin-voi-sanoo-esittaa
otetaan-yhdet
linda-maria
io-techin-tekniikkapodcast
rss-tasta-on-kyse-ivan-puopolo-verkkouutiset
rikosmyytit
rss-polikulaari-humanisti-vastaa-ja-muut-ts-podcastit
viela-yksi-sivu
rss-uusi-juttu
rss-aika-ankkuri
rss-kaikki-uusiksi
rss-merja-mahkan-rahat