Shaping AI Benchmarks with Together AI Co-Founder Percy Liang

Shaping AI Benchmarks with Together AI Co-Founder Percy Liang

In this episode of Gradient Dissent, Together AI co-founder and Stanford Associate Professor Percy Liang joins host, Lukas Biewald, to discuss advancements in AI benchmarking and the pivotal role that open-source plays in AI development.

He shares his development of HELM—a robust framework for evaluating language models. The discussion highlights how this framework improves transparency and effectiveness in AI benchmarks. Additionally, Percy shares insights on the pivotal role of open-source models in democratizing AI development and addresses the challenges of English language bias in global AI applications. This episode offers in-depth insights into how benchmarks are shaping the future of AI, highlighting both technological advancements and the push for more equitable and inclusive technologies.

Subscribe to Weights & Biases http://wandb.me/yt_subscribe

Connect with Percy Liang:


Anticipatory Music Composer:


Blog Post:


Follow Weights & Biases:


Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(138)

He's Building an AI That Can't Lie | Dan Klein

He's Building an AI That Can't Lie | Dan Klein

"We are going to switch from the problem in AI being that nothing works to the problem being that everything works."Dan Klein has been studying language models for over two decades and is now a profes...

16 Kesä 1h 14min

He Raised $70M to Cure Every Disease With AI | Samuel G. Rodriques, Edison Scientific

He Raised $70M to Cure Every Disease With AI | Samuel G. Rodriques, Edison Scientific

Samuel Rodriques left physics because there were no unsolved problems left.Instead, he built an AI scientist named Kosmos to cure every disease, solve aging, and map the human brain.In this episode:Th...

26 Touko 1h 14min

Uber, Nissan, and Mercedes Chose This Self-Driving Startup | Alex Kendall, Wayve

Uber, Nissan, and Mercedes Chose This Self-Driving Startup | Alex Kendall, Wayve

"Every vehicle is capable of driverless operation. That's clearly the steady state of where we're going."Wayve started in a rented house in Cambridge with $1.5M, a car in the garage, and an aim to int...

15 Huhti 45min

Why Netflix, Uber, and Spotify Never Lag: The Database Nobody Talks About | Aaron Katz

Why Netflix, Uber, and Spotify Never Lag: The Database Nobody Talks About | Aaron Katz

"Companies designing for agents, not humans, are going to get a lot of lift."ClickHouse started as an internal tool at Yandex. Today it's the database Anthropic, OpenAI, Meta and Tesla all run on.In t...

31 Maalis 43min

The $64M Bet on an AI That Has to Be Right | Carina Hong, CEO of Axiom

The $64M Bet on an AI That Has to Be Right | Carina Hong, CEO of Axiom

Formal verification already consumes years of human effort.In this episode, Lukas Biewald talks with Carina Hong, Founder & CEO of Axiom, about why verification is becoming the real bottleneck in high...

5 Helmi 50min

What a $42B Software Co. Really Spends on AI Tools

What a $42B Software Co. Really Spends on AI Tools

“I don't worry about being replaced by AI. I worry about being replaced by someone who's really good at using AI.”Atlassian has 10,000+ engineers currently split-testing the world’s top AI coding tool...

20 Tammi 1h 7min

Inside the $41B AI Cloud Challenging Big Tech | CoreWeave SVP

Inside the $41B AI Cloud Challenging Big Tech | CoreWeave SVP

The future of AI training is shaped by one constraint: keeping GPUs fed.In this episode, Lukas Biewald talks with CoreWeave SVP Corey Sanders about why general-purpose clouds start to break down under...

6 Tammi 53min

Why Physical AI Needed a Completely New Data Stack

Why Physical AI Needed a Completely New Data Stack

The future of AI is physical. In this episode, Lukas Biewald talks to Nikolaus West, CEO of Rerun, about why the breakthrough required to get AI out of the lab and into the messy real world is blocked...

16 Joulu 20251h

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
mimmit-sijoittaa
psykopodiaa-podcast
rss-rahapodi
rss-sami-miettinen-neuvottelija
oppimisen-psykologia
ostan-asuntoja-podcast
rahapuhetta
hyva-paha-johtaminen
rss-perho-rajoilla
rss-karon-grilli
rss-oivalluksia-rahasta-elamasta
asuntoasiaa-paivakirjat
rss-inderes
rss-rahataito-podcast
rss-ysin-muijat
rss-pinnan-alla-kiehuu
rss-tarkeista-asioista-2
rss-rentotapaus
rss-paasipodi