Evaluating LLMs with Chatbot Arena and Joseph E. Gonzalez

Evaluating LLMs with Chatbot Arena and Joseph E. Gonzalez

In this episode of Gradient Dissent, Joseph E. Gonzalez, EECS Professor at UC Berkeley and Co-Founder at RunLLM, joins host Lukas Biewald to explore innovative approaches to evaluating LLMs.

They discuss the concept of vibes-based evaluation, which examines not just accuracy but also the style and tone of model responses, and how Chatbot Arena has become a community-driven benchmark for open-source and commercial LLMs. Joseph shares insights on democratizing model evaluation, refining AI-human interactions, and leveraging human preferences to improve model performance. This episode provides a deep dive into the evolving landscape of LLM evaluation and its impact on AI development.

🎙 Get our podcasts on these platforms:

Apple Podcasts: http://wandb.me/apple-podcasts

Spotify: http://wandb.me/spotify

Google: http://wandb.me/gd_google

YouTube: http://wandb.me/youtube

Follow Weights & Biases:

https://twitter.com/weights_biases

https://www.linkedin.com/company/wandb

Join the Weights & Biases Discord Server:

https://discord.gg/CkZKRNnaf3

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(136)

AI in electronics: Quilter’s journey in PCB design

AI in electronics: Quilter’s journey in PCB design

In this episode of Gradient Dissent, Sergiy Nesterenko, CEO of Quilter, joins host Lukas Biewald to discuss the groundbreaking use of reinforcement learning in PCB design. Learn how Quilter automates ...

6 Juni 202443min

The Future of AI in Coding with Codeium CEO Varun Mohan

The Future of AI in Coding with Codeium CEO Varun Mohan

In this episode of Gradient Dissent, Varun Mohan, Co-Founder & CEO of Codeium, joins host Lukas Biewald to discuss the transformative power of AI in coding. They explore how Codeium evolved from GPU v...

23 Maj 202454min

Shaping AI Benchmarks with Together AI Co-Founder Percy Liang

Shaping AI Benchmarks with Together AI Co-Founder Percy Liang

In this episode of Gradient Dissent, Together AI co-founder and Stanford Associate Professor Percy Liang joins host, Lukas Biewald, to discuss advancements in AI benchmarking and the pivotal role that...

9 Maj 202453min

Accelerating drug discovery with AI: Insights from Isomorphic Labs

Accelerating drug discovery with AI: Insights from Isomorphic Labs

In this episode of Gradient Dissent, Isomorphic Labs Chief AI Officer Max Jaderberg, and Chief Technology Officer Sergei Yakneen join our host Lukas Biewald to discuss the advancements in biotech and ...

25 Apr 20241h 10min

Redefining AI Hardware for Enterprise with SambaNova’s Rodrigo Liang

Redefining AI Hardware for Enterprise with SambaNova’s Rodrigo Liang

🚀 Discover the cutting-edge AI hardware development for enterprises in this episode of Gradient Dissent, featuring Rodrigo Liang, CEO of SambaNova Systems. Rodrigo Liang’s journey from Oracle to foun...

11 Apr 202453min

Navigating the Vector Database Landscape with Pinecone's Edo Liberty

Navigating the Vector Database Landscape with Pinecone's Edo Liberty

🚀 This episode of Gradient Dissent welcomes Edo Liberty, the mind behind Pinecone's revolutionary vector database technology.As a former leader at Amazon AI Labs and Yahoo's New York lab, Edo Liberty...

28 Mars 20241h 6min

Transforming Data into Business Solutions with Salesforce AI CEO, Clara Shih

Transforming Data into Business Solutions with Salesforce AI CEO, Clara Shih

🚀 In this episode of Gradient Dissent, we explore the revolutionary impact of AI across industries with Clara Shih, CEO of Salesforce AI and Founder of Hearsay Systems. Dive into Salesforce AI's cutt...

14 Mars 202458min

Upgrading Your Health: Navigating AI's Future In Healthcare with John Halamka of Mayo Clinic Platform

Upgrading Your Health: Navigating AI's Future In Healthcare with John Halamka of Mayo Clinic Platform

In the newest episode of Gradient Dissent, we explore the intersecting worlds of AI and Healthcare with John Halamka, President of the Mayo Clinic Platform.Journey with us down John Halamka's remarkab...

29 Feb 20241h 4min

Populärt inom Business & ekonomi

framgangspodden
varvet
rss-jossan-nina
badfluence
rss-svart-marknad
svd-tech-brief
uppgang-och-fall
bathina-en-podcast
avanzapodden
rss-inga-dumma-fragor-om-pengar
rss-borsens-finest
tabberaset
dynastin
kapitalet-en-podd-om-ekonomi
rss-dagen-med-di
fill-or-kill
rss-dr-bjorklund
lastbilspodden
24fragor
rss-den-nya-ekonomin