#71 - ZAK JOST (Graph Neural Networks + Geometric DL) [UNPLUGGED]

#71 - ZAK JOST (Graph Neural Networks + Geometric DL) [UNPLUGGED]

Special discount link for Zak's GNN course - https://bit.ly/3uqmYVq

Patreon: https://www.patreon.com/mlst

Discord: https://discord.gg/ESrGqhf5CB

YT version: https://youtu.be/jAGIuobLp60 (there are lots of helper graphics there, recommended if poss)


Want to sponsor MLST!? Let us know on Linkedin / Twitter.


[00:00:00] Preamble

[00:03:12] Geometric deep learning

[00:10:04] Message passing

[00:20:42] Top down vs bottom up

[00:24:59] All NN architectures are different forms of information diffusion processes (squashing and smoothing problem)

[00:29:51] Graph rewiring

[00:31:38] Back to information diffusion

[00:42:43] Transformers vs GNNs

[00:47:10] Equivariant subgraph aggregation networks + WL test

[00:55:36] Do equivariant layers aggregate too?

[00:57:49] Zak's GNN course


Exhaustive list of references on the YT show URL (https://youtu.be/jAGIuobLp60)

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(271)

What Most People Get Wrong About Evolution | Akarsh Kumar

What Most People Get Wrong About Evolution | Akarsh Kumar

A lot of people in AI treat evolution as a dumb fallback, basically random search for when you can't take a gradient. Akarsh Kumar thinks that is wrong. Selection hangs on to partial solutions, so mut...

10 Okt 47min

How a Voice Agent Learns the Rhythm of Conversation — Shawn Wen

How a Voice Agent Learns the Rhythm of Conversation — Shawn Wen

Tsung-Hsien (Shawn) Wen, CTO of PolyAI, tells Tim Scarfe why voice agents are harder than text agents. Voice adds time, and a good conversation depends on adapting to the person on the line, not just ...

1 Okt 1h 10min

Who Checks a Proof No Human Can Read? — Leo de Moura

Who Checks a Proof No Human Can Read? — Leo de Moura

Leonardo de Moura created Lean and co-created Z3. ---This episode is sponsored by Parallel.Parallel, where agents find answers: web search, extraction and deep research APIs built for AI agents.Start ...

30 Sep 1h 14min

When AI Research Starts Moving Faster Than Human Research - Zhengyao Jiang

When AI Research Starts Moving Faster Than Human Research - Zhengyao Jiang

Weco let an AI coding agent rewrite the harness around another agent for eight days: its code, prompts and tools, while the underlying language model stayed fixed. Tim Scarfe asks Weco co-founder Zhen...

26 Sep 43min

How Deep Learning Finally Cracked Messy Tables - Frank Hutter

How Deep Learning Finally Cracked Messy Tables - Frank Hutter

Frank Hutter, co-founder of Prior Labs, talks about TabPFN, a tabular foundation model that makes predictions in a single forward pass, and the research behind it.TabPFN is pre-trained on synthetic da...

23 Sep 1h 53min

Why Scaling Prediction Cannot Create Intelligence - Alexander Mattick

Why Scaling Prediction Cannot Create Intelligence - Alexander Mattick

Alexander Mattick is a researcher at Fraunhofer IIS and a PhD researcher at the University of Technology Nuremberg (UTN), and a regular on Yannic Kilcher's Discord. He first came on MLST in 2022, afte...

21 Sep 2h 14min

How Physical AI Learns Across Language, Video and Action — Ming-Yu Liu

How Physical AI Learns Across Language, Video and Action — Ming-Yu Liu

The car making a left turn at the start of this episode was never filmed. Cosmos 3 generated it. Ming-Yu Liu, who leads the Cosmos research at NVIDIA, explains how one model can describe a video, gene...

15 Sep 25min

Speech Recognition Is Not a Solved Problem — Pavan Kumar Reddy

Speech Recognition Is Not a Solved Problem — Pavan Kumar Reddy

Pavan Kumar Reddy leads audio research at Mistral AI. He joins Tim Scarfe for a deep technical tour of Voxtral — and explains why the frontier of deployed voice is still a cascade of specialised model...

14 Sep 1h 42min

Populært innen Teknologi

energi-og-klima
teknisk-sett
lydartikler-fra-aftenposten
elektropodden
nasjonal-sikkerhetsmyndighet-nsm
tomprat-med-gunnar-tjomlid
rss-ai-forklart
rss-alt-som-gar-pa-strom
rss-kunstig-intelligens-med-elisabeth-maren-og-morten
shifter
smart-forklart
fornybaren
rss-alt-vi-kan
rss-bak-skyen
pedagogisk-intelligens
rss-romnasjonen
rss-teknologioptimistene-en-podkast-om-teknologi-og-mennesker
rss-heis
rss-larervarelset
rss-hvorfor-ble-det-sann