Sara Hooker - The Hardware Lottery, Sparsity and Fairness

Sara Hooker - The Hardware Lottery, Sparsity and Fairness

Dr. Tim Scarfe, Yannic Kilcher and Sayak Paul chat with Sara Hooker from the Google Brain team! We discuss her recent hardware lottery paper, pruning / sparsity, bias mitigation and intepretability.

The hardware lottery -- what causes inertia or friction in the marketplace of ideas? Is there a meritocracy of ideas or do the previous decisions we have made enslave us? Sara Hooker calls this a lottery because she feels that machine learning progress is entirely beholdant to the hardware and software landscape. Ideas succeed if they are compatible with the hardware and software at the time and also the existing inventions. The machine learning community is exceptional because the pace of innovation is fast and we operate largely in the open, this is largely because we don't build anything physical which is expensive, slow and the cost of being scooped is high. We get stuck in basins of attraction based on our technology decisions and it's expensive to jump outside of these basins. So is this story unique to hardware and AI algorithms or is it really just the story of all innovation? Every great innovation must wait for the right stepping stone to be in place before it can really happen. We are excited to bring you Sara Hooker to give her take.

YouTube version (including TOC): https://youtu.be/sQFxbQ7ade0

Show notes; https://drive.google.com/file/d/1S_rHnhaoVX4Nzx_8e3ESQq4uSswASNo7/view?usp=sharing

Sara Hooker page; https://www.sarahooker.me



Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(271)

What Most People Get Wrong About Evolution | Akarsh Kumar

What Most People Get Wrong About Evolution | Akarsh Kumar

A lot of people in AI treat evolution as a dumb fallback, basically random search for when you can't take a gradient. Akarsh Kumar thinks that is wrong. Selection hangs on to partial solutions, so mut...

10 Okt 47min

How a Voice Agent Learns the Rhythm of Conversation — Shawn Wen

How a Voice Agent Learns the Rhythm of Conversation — Shawn Wen

Tsung-Hsien (Shawn) Wen, CTO of PolyAI, tells Tim Scarfe why voice agents are harder than text agents. Voice adds time, and a good conversation depends on adapting to the person on the line, not just ...

1 Okt 1h 10min

Who Checks a Proof No Human Can Read? — Leo de Moura

Who Checks a Proof No Human Can Read? — Leo de Moura

Leonardo de Moura created Lean and co-created Z3. ---This episode is sponsored by Parallel.Parallel, where agents find answers: web search, extraction and deep research APIs built for AI agents.Start ...

30 Sep 1h 14min

When AI Research Starts Moving Faster Than Human Research - Zhengyao Jiang

When AI Research Starts Moving Faster Than Human Research - Zhengyao Jiang

Weco let an AI coding agent rewrite the harness around another agent for eight days: its code, prompts and tools, while the underlying language model stayed fixed. Tim Scarfe asks Weco co-founder Zhen...

26 Sep 43min

How Deep Learning Finally Cracked Messy Tables - Frank Hutter

How Deep Learning Finally Cracked Messy Tables - Frank Hutter

Frank Hutter, co-founder of Prior Labs, talks about TabPFN, a tabular foundation model that makes predictions in a single forward pass, and the research behind it.TabPFN is pre-trained on synthetic da...

23 Sep 1h 53min

Why Scaling Prediction Cannot Create Intelligence - Alexander Mattick

Why Scaling Prediction Cannot Create Intelligence - Alexander Mattick

Alexander Mattick is a researcher at Fraunhofer IIS and a PhD researcher at the University of Technology Nuremberg (UTN), and a regular on Yannic Kilcher's Discord. He first came on MLST in 2022, afte...

21 Sep 2h 14min

How Physical AI Learns Across Language, Video and Action — Ming-Yu Liu

How Physical AI Learns Across Language, Video and Action — Ming-Yu Liu

The car making a left turn at the start of this episode was never filmed. Cosmos 3 generated it. Ming-Yu Liu, who leads the Cosmos research at NVIDIA, explains how one model can describe a video, gene...

15 Sep 25min

Speech Recognition Is Not a Solved Problem — Pavan Kumar Reddy

Speech Recognition Is Not a Solved Problem — Pavan Kumar Reddy

Pavan Kumar Reddy leads audio research at Mistral AI. He joins Tim Scarfe for a deep technical tour of Voxtral — and explains why the frontier of deployed voice is still a cascade of specialised model...

14 Sep 1h 42min

Populärt inom Teknik

uppgang-och-fall
rss-ai-med-jonas-benjamin
market-makers
elbilsveckan
rss-technokratin
natets-morka-sida
bilar-med-sladd
rss-laddstationen-med-elbilen-i-sverige
skogsforum-podcast
rss-snacka-om-ai
rss-elektrikerpodden
gubbar-som-tjotar-om-bilar
rss-upplyst-entreprenordirektor
bli-saker-podden
vi-bilagares-podcast
rss-veckans-ai
rss-uppgang-och-fall
rss-en-ai-till-kaffet
rss-fabriken-2
hej-bruksbil