Evaluating LLMs with Chatbot Arena and Joseph E. Gonzalez

Evaluating LLMs with Chatbot Arena and Joseph E. Gonzalez

In this episode of Gradient Dissent, Joseph E. Gonzalez, EECS Professor at UC Berkeley and Co-Founder at RunLLM, joins host Lukas Biewald to explore innovative approaches to evaluating LLMs.

They discuss the concept of vibes-based evaluation, which examines not just accuracy but also the style and tone of model responses, and how Chatbot Arena has become a community-driven benchmark for open-source and commercial LLMs. Joseph shares insights on democratizing model evaluation, refining AI-human interactions, and leveraging human preferences to improve model performance. This episode provides a deep dive into the evolving landscape of LLM evaluation and its impact on AI development.

🎙 Get our podcasts on these platforms:

Apple Podcasts: http://wandb.me/apple-podcasts

Spotify: http://wandb.me/spotify

Google: http://wandb.me/gd_google

YouTube: http://wandb.me/youtube

Follow Weights & Biases:

https://twitter.com/weights_biases

https://www.linkedin.com/company/wandb

Join the Weights & Biases Discord Server:

https://discord.gg/CkZKRNnaf3

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(136)

Snowflake’s CEO Sridhar Ramaswamy on 700+ LLM enterprise use cases

Snowflake’s CEO Sridhar Ramaswamy on 700+ LLM enterprise use cases

In this episode of Gradient Dissent, Snowflake CEO Sridhar Ramaswamy joins host Lukas Biewald to explore how AI is transforming enterprise data strategies.They discuss Sridhar's journey from Google to...

10 Okt 202455min

Elevating ML Infrastructure with Modal Labs CEO Erik Bernhardsson

Elevating ML Infrastructure with Modal Labs CEO Erik Bernhardsson

In this episode of Gradient Dissent, Erik Bernhardsson, CEO & Founder of Modal Labs, joins host Lukas Biewald to discuss the future of machine learning infrastructure. They explore how Modal is enhanc...

26 Sep 202449min

From No-Code to AI-Powered Apps with Airtable’s Howie Liu

From No-Code to AI-Powered Apps with Airtable’s Howie Liu

In this episode of Gradient Dissent, Howie Lou, CEO of Airtable, joins host Lukas Biewald to dive into Airtable's transformation from a no-code app builder to a platform capable of supporting complex ...

12 Sep 20241h 12min

Launching the Fastest AI Inference Solution with Cerebras Systems CEO Andrew Feldman

Launching the Fastest AI Inference Solution with Cerebras Systems CEO Andrew Feldman

In this episode of Gradient Dissent, Andrew Feldman, CEO of Cerebras Systems, joins host Lukas Biewald to discuss the latest advancements in AI inference technology. They explore Cerebras Systems' gro...

27 Aug 202453min

Reinventing AI Agents with Imbue CEO Kanjun Qiu

Reinventing AI Agents with Imbue CEO Kanjun Qiu

In this episode of Gradient Dissent, Kanjun Qiu, CEO and Co-founder of Imbue, joins host Lukas Biewald to discuss how AI agents are transforming code generation and software development. Discover the ...

8 Aug 202448min

From startup to $1.2B with Lambda’s Stephen Balaban

From startup to $1.2B with Lambda’s Stephen Balaban

In this episode of Gradient Dissent, Stephen Balaban, CEO of Lambda Labs, joins host Lukas Biewald to discuss the journey of scaling Lambda Labs to an impressive $400M in revenue. They explore the piv...

25 Jul 202449min

Harnessing AI for legal practice with CoCounsel’s Jake Heller

Harnessing AI for legal practice with CoCounsel’s Jake Heller

In this episode of Gradient Dissent, Jake Heller, Head of Product, CoCounsel, joins host Lukas Biewald to discuss how AI is innovating legal practices and reshaping educational approaches for aspiring...

11 Jul 20241h 4min

Transforming Search with Perplexity AI’s CTO Denis Yarats

Transforming Search with Perplexity AI’s CTO Denis Yarats

In this episode of Gradient Dissent, Denis Yarats, CTO of Perplexity, joins host Lukas Biewald to discuss the innovative use of AI in creating high-quality, fast search engine answers.Discover how Per...

20 Jun 202443min

Populært innen Business og økonomi

stopp-verden
dine-penger-pengeradet
lydartikler-fra-aftenposten
rss-penger-polser-og-politikk
e24-podden
rss-borsmorgen-okonominyhetene
rss-skravla-gar
pengepodden-2
livet-pa-veien-med-jan-erik-larssen
pengesnakk
rss-pa-konto
utbytte
tid-er-penger-en-podcast-med-peter-warren
finansredaksjonen
rss-sunn-okonomi
morgenkaffen-med-finansavisen
liberal-halvtime
rss-markedspuls-2
lederpodden
okonomiamatorene