#71 - ZAK JOST (Graph Neural Networks + Geometric DL) [UNPLUGGED]

#71 - ZAK JOST (Graph Neural Networks + Geometric DL) [UNPLUGGED]

Special discount link for Zak's GNN course - https://bit.ly/3uqmYVq

Patreon: https://www.patreon.com/mlst

Discord: https://discord.gg/ESrGqhf5CB

YT version: https://youtu.be/jAGIuobLp60 (there are lots of helper graphics there, recommended if poss)


Want to sponsor MLST!? Let us know on Linkedin / Twitter.


[00:00:00] Preamble

[00:03:12] Geometric deep learning

[00:10:04] Message passing

[00:20:42] Top down vs bottom up

[00:24:59] All NN architectures are different forms of information diffusion processes (squashing and smoothing problem)

[00:29:51] Graph rewiring

[00:31:38] Back to information diffusion

[00:42:43] Transformers vs GNNs

[00:47:10] Equivariant subgraph aggregation networks + WL test

[00:55:36] Do equivariant layers aggregate too?

[00:57:49] Zak's GNN course


Exhaustive list of references on the YT show URL (https://youtu.be/jAGIuobLp60)

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(260)

Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander Panfilov

Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander Panfilov

Tim Scarfe speaks with Ilia Shumailov and Alexander Panfilov about their paper, Stealing Reasoning Traces from Proprietary LLM APIs.The core bug sounds deceptively simple: providers return encrypted r...

22 Aug 49min

Every Exponential Ends — Silicon Valley Forgot — Adam Becker

Every Exponential Ends — Silicon Valley Forgot — Adam Becker

Astrophysicist Adam Becker, author of "What Is Real?", joins Tim Scarfe to take apart the futures Silicon Valley keeps selling: the 2045 singularity, mind uploading, Mars colonies, and the AI apocalyp...

20 Aug 1h 18min

AI Is Learning at the Wrong Level of Abstraction — Matthieu Wyart

AI Is Learning at the Wrong Level of Abstraction — Matthieu Wyart

This episode is sponsored by Notion. Learn more about Notion's Developer Platform today at https://notion.com/mlstWhy can deep networks discover abstractions that shallow models miss? Statistical phys...

10 Aug 1h 18min

How Researchers Test AI for Hidden Goals — Apollo Research

How Researchers Test AI for Hidden Goals — Apollo Research

Can an AI do the right thing for the wrong reason? Tim Scarfe speaks with Apollo Research’s Alexander Meinke, Axel Højmark and Jérémy Scheurer about Measuring Reward-Seeking via Contrastive Belief Upd...

31 Juli 1h 18min

Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

This episode is sponsored by Notion. Learn more about Notion's Developer Platform today at https://notion.com/mlstBritain's most capable coding model can't be exported, and that ban is the whole reaso...

13 Juli 55min

 The Benchmark With No Instructions — ARC-AGI-3 (winning team!)

The Benchmark With No Instructions — ARC-AGI-3 (winning team!)

Tim Scarfe travels to Zurich to sit down with the Tufa Labs ARC-AGI-3 team — founder Benjamin Crouzier, with Jeroen Cottaar, Dries Smit, Stefano Viel and Michal Tesnar — to work out what their leaderb...

1 Juli 1h 24min

The Thermodynamic AI Computing Chip - Thomas Ahle

The Thermodynamic AI Computing Chip - Thomas Ahle

Thomas Ahle wants Normal Computing to be the Lovable for chip design: type your intent, and a swarm of agents carries it from design through optimisation, formalisation and verification to tape-out. T...

28 Juni 1h 2min

He won a Nobel here for AlphaFold. Then he left. - John Jumper

He won a Nobel here for AlphaFold. Then he left. - John Jumper

This episode is sponsored by Notion. Learn more about Notion's Developer Platform today at https://notion.com/mlstProtein folding stalled biology for fifty years. A sequence of amino acids dictates a ...

22 Juni 53min

Populärt inom Teknik

uppgang-och-fall
market-makers
rss-elektrikerpodden
rss-laddstationen-med-elbilen-i-sverige
 och-bilen-gar-bra
rss-technokratin
bilar-med-sladd
bli-saker-podden
skogsforum-podcast
gubbar-som-tjotar-om-bilar
natets-morka-sida
rss-en-ai-till-kaffet
rss-uppgang-och-fall
bosse-bildoktorn-och-hasse-p
rss-veckans-ai
hej-bruksbil
rss-fabriken-2
klocksnack-tillsammans-med-nymans-ur-1851
elbilsveckan
developers-mer-an-bara-kod