Evaluating LLMs with Chatbot Arena and Joseph E. Gonzalez

Evaluating LLMs with Chatbot Arena and Joseph E. Gonzalez

In this episode of Gradient Dissent, Joseph E. Gonzalez, EECS Professor at UC Berkeley and Co-Founder at RunLLM, joins host Lukas Biewald to explore innovative approaches to evaluating LLMs.

They discuss the concept of vibes-based evaluation, which examines not just accuracy but also the style and tone of model responses, and how Chatbot Arena has become a community-driven benchmark for open-source and commercial LLMs. Joseph shares insights on democratizing model evaluation, refining AI-human interactions, and leveraging human preferences to improve model performance. This episode provides a deep dive into the evolving landscape of LLM evaluation and its impact on AI development.

🎙 Get our podcasts on these platforms:

Apple Podcasts: http://wandb.me/apple-podcasts

Spotify: http://wandb.me/spotify

Google: http://wandb.me/gd_google

YouTube: http://wandb.me/youtube


Follow Weights & Biases:

https://twitter.com/weights_biases

https://www.linkedin.com/company/wandb


Join the Weights & Biases Discord Server:

https://discord.gg/CkZKRNnaf3

Avsnitt(134)

Shaping AI Benchmarks with Together AI Co-Founder Percy Liang

Shaping AI Benchmarks with Together AI Co-Founder Percy Liang

In this episode of Gradient Dissent, Together AI co-founder and Stanford Associate Professor Percy Liang joins host, Lukas Biewald, to discuss advancements in AI benchmarking and the pivotal role that...

9 Maj 202453min

Accelerating drug discovery with AI: Insights from Isomorphic Labs

Accelerating drug discovery with AI: Insights from Isomorphic Labs

In this episode of Gradient Dissent, Isomorphic Labs Chief AI Officer Max Jaderberg, and Chief Technology Officer Sergei Yakneen join our host Lukas Biewald to discuss the advancements in biotech and ...

25 Apr 20241h 10min

Redefining AI Hardware for Enterprise with SambaNova’s Rodrigo Liang

Redefining AI Hardware for Enterprise with SambaNova’s Rodrigo Liang

🚀 Discover the cutting-edge AI hardware development for enterprises in this episode of Gradient Dissent, featuring Rodrigo Liang, CEO of SambaNova Systems. Rodrigo Liang’s journey from Oracle to foun...

11 Apr 202453min

Navigating the Vector Database Landscape with Pinecone's Edo Liberty

Navigating the Vector Database Landscape with Pinecone's Edo Liberty

🚀 This episode of Gradient Dissent welcomes Edo Liberty, the mind behind Pinecone's revolutionary vector database technology.As a former leader at Amazon AI Labs and Yahoo's New York lab, Edo Liberty...

28 Mars 20241h 6min

Transforming Data into Business Solutions with Salesforce AI CEO, Clara Shih

Transforming Data into Business Solutions with Salesforce AI CEO, Clara Shih

🚀 In this episode of Gradient Dissent, we explore the revolutionary impact of AI across industries with Clara Shih, CEO of Salesforce AI and Founder of Hearsay Systems. Dive into Salesforce AI's cutt...

14 Mars 202458min

Upgrading Your Health: Navigating AI's Future In Healthcare with John Halamka of Mayo Clinic Platform

Upgrading Your Health: Navigating AI's Future In Healthcare with John Halamka of Mayo Clinic Platform

In the newest episode of Gradient Dissent, we explore the intersecting worlds of AI and Healthcare with John Halamka, President of the Mayo Clinic Platform.Journey with us down John Halamka's remarkab...

29 Feb 20241h 4min

Shaping the World of Robotics with Chelsea Finn

Shaping the World of Robotics with Chelsea Finn

In the newest episode of Gradient Dissent, Chelsea Finn, Assistant Professor at Stanford's Computer Science Department, discusses the forefront of robotics and machine learning.Discover her groundbrea...

15 Feb 202453min

The Power of AI in Search with You.com's Richard Socher

The Power of AI in Search with You.com's Richard Socher

In the latest episode of Gradient Dissent, Richard Socher, CEO of You.com, shares his insights on the power of AI in search. The episode focuses on how advanced language models like GPT-4 are transfor...

1 Feb 20241h 8min

Populärt inom Business & ekonomi

framgangspodden
varvet
badfluence
rss-jossan-nina
rss-borsens-finest
avanzapodden
svd-tech-brief
rss-svart-marknad
uppgang-och-fall
fill-or-kill
rss-dagen-med-di
borsmorgon
kapitalet-en-podd-om-ekonomi
affarsvarlden
rss-kort-lang-analyspodden-fran-di
tabberaset
lastbilspodden
24fragor
bathina-en-podcast
borslunch-2