Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.

Jaksot(779)

Neural Network Quantization and Compression with Tijmen Blankevoort - TWIML Talk #292

Neural Network Quantization and Compression with Tijmen Blankevoort - TWIML Talk #292

Today we’re joined by Tijmen Blankevoort, a staff engineer at Qualcomm, who leads their compression and quantization research teams. In our conversation with Tijmen we discuss:  • The ins and outs of...

19 Elo 201950min

Identifying New Materials with NLP with Anubhav Jain - TWIML Talk #291

Identifying New Materials with NLP with Anubhav Jain - TWIML Talk #291

Today we are joined by Anubhav Jain, Staff Scientist & Chemist at Lawrence Berkeley National Lab. We discuss his latest paper, ‘Unsupervised word embeddings capture latent knowledge from materials sci...

15 Elo 201939min

The Problem with Black Boxes with Cynthia Rudin - TWIML Talk #290

The Problem with Black Boxes with Cynthia Rudin - TWIML Talk #290

Today we are joined by Cynthia Rudin, Professor of Computer Science, Electrical and Computer Engineering, and Statistical Science at Duke University. In this episode we discuss her paper, ‘Please Stop...

14 Elo 201948min

Human-Robot Interaction and Empathy with Kate Darling - TWIML Talk #289

Human-Robot Interaction and Empathy with Kate Darling - TWIML Talk #289

Today we’re joined by Dr. Kate Darling, Research Specialist at the MIT Media Lab. Kate’s focus is on robot ethics, the social implication of how people treat robots and the purposeful design of robots...

8 Elo 201943min

Automated ML for RNA Design with Danny Stoll - TWIML Talk #288

Automated ML for RNA Design with Danny Stoll - TWIML Talk #288

Today we’re joined by Danny Stoll, Research Assistant at the University of Freiburg. Danny’s current research can be encapsulated in his latest paper, ‘Learning to Design RNA’. In this episode, Danny ...

5 Elo 201937min

Developing a brain atlas using deep learning with Theofanis Karayannis - TWIML Talk #287

Developing a brain atlas using deep learning with Theofanis Karayannis - TWIML Talk #287

Today we’re joined by Theofanis Karayannis, Assistant Professor at the Brain Research Institute of the University of Zurich. Theo’s research is focused on brain circuit development and uses Deep Learn...

1 Elo 201937min

Environmental Impact of Large-Scale NLP Model Training with Emma Strubell - TWIML Talk #286

Environmental Impact of Large-Scale NLP Model Training with Emma Strubell - TWIML Talk #286

Today we’re joined by Emma Strubell, currently a visiting scientist at Facebook AI Research. Emma’s focus is bringing state of the art NLP systems to practitioners by developing efficient and robust m...

29 Heinä 201937min

“Fairwashing” and the Folly of ML Solutionism with Zachary Lipton - TWIML Talk #285

“Fairwashing” and the Folly of ML Solutionism with Zachary Lipton - TWIML Talk #285

Today we’re joined by Zachary Lipton, Assistant Professor in the Tepper School of Business. With a theme of data interpretation, Zachary’s research is focused on machine learning in healthcare, with t...

25 Heinä 20191h 15min

Suosittua kategoriassa Politiikka ja uutiset

aikalisa
rss-ootsa-kuullut-tasta
tervo-halme
ootsa-kuullut-tasta-2
politiikan-puskaradio
rss-vaalirankkurit-podcast
viisupodi
rss-podme-livebox
otetaan-yhdet
et-sa-noin-voi-sanoo-esittaa
rss-tasta-on-kyse-ivan-puopolo-verkkouutiset
rss-asiastudio
the-ulkopolitist
mtv-uutiset-polloraati
rss-kaikki-uusiksi
rss-hyvaa-huomenta-bryssel
rss-merja-mahkan-rahat
rss-kuka-mina-olen
rss-raha-talous-ja-politiikka
rss-sanna-ukkola-show-verkkouutiset