Machine Learning Street Talk (MLST)27 Dec 2020

#035 Christmas Community Edition!

Welcome to the Christmas special community edition of MLST! We discuss some recent and interesting papers from Pedro Domingos (are NNs kernel machines?), Deepmind (can NNs out-reason symbolic machines?), Anna Rodgers - When BERT Plays The Lottery, All Tickets Are Winning, Prof. Mark Bishop (even causal methods won't deliver understanding), We also cover our favourite bits from the recent Montreal AI event run by Prof. Gary Marcus (including Rich Sutton, Danny Kahneman and Christof Koch). We respond to a reader mail on Capsule networks. Then we do a deep dive into Type Theory and Lambda Calculus with community member Alex Mattick. In the final hour we discuss inductive priors and label information density with another one of our discord community members.

Panel: Dr. Tim Scarfe, Yannic Kilcher, Alex Stenlake, Dr. Keith Duggar

Enjoy the show and don't forget to subscribe!

00:00:00 Welcome to Christmas Special!

00:00:44 SoTa meme

00:01:30 Happy Christmas!

00:03:11 Paper -- DeepMind - Outperforming neuro-symbolic models with NNs (Ding et al)

00:08:57 What does it mean to understand?

00:17:37 Paper - Prof. Mark Bishop Artificial Intelligence is stupid and causal reasoning

wont fix it

00:25:39 Paper -- Pedro Domingos - Every Model Learned by Gradient Descent Is Approximately a Kernel Machine

00:31:07 Paper - Bengio - Inductive Biases for Deep Learning of Higher-Level Cognition

00:32:54 Anna Rodgers - When BERT Plays The Lottery, All Tickets Are Winning

00:37:16 Montreal AI event - Gary Marcus on reasoning

00:40:37 Montreal AI event -- Rich Sutton on universal theory of AI

00:49:45 Montreal AI event -- Danny Kahneman, System 1 vs 2 and Generative Models ala free energy principle

01:02:57 Montreal AI event -- Christof Koch - Neuroscience is hard

01:10:55 Markus Carr -- reader letter on capsule networks

01:13:21 Alex response to Marcus Carr

01:22:06 Type theory segment -- with Alex Mattick from Discord

01:24:45 Type theory segment -- What is Type Theory

01:28:12 Type theory segment -- Difference between functional and OOP languages

01:29:03 Type theory segment -- Lambda calculus

01:30:46 Type theory segment -- Closures

01:35:05 Type theory segment -- Term rewriting (confluency and termination)

01:42:02 MType theory segment -- eta term rewritig system - Lambda Calculus

01:54:44 Type theory segment -- Types / semantics

02:06:26 Type theory segment -- Calculus of constructions

02:09:27 Type theory segment -- Homotopy type theory

02:11:02 Type theory segment -- Deep learning link

02:17:27 Jan from Discord segment -- Chrome MRU skit

02:18:56 Jan from Discord segment -- Inductive priors (with XMaster96/Jan from Discord)

02:37:59 Jan from Discord segment -- Label information density (with XMaster96/Jan from Discord)

02:55:13 Outro

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(271)

What Most People Get Wrong About Evolution | Akarsh Kumar

A lot of people in AI treat evolution as a dumb fallback, basically random search for when you can't take a gradient. Akarsh Kumar thinks that is wrong. Selection hangs on to partial solutions, so mut...

10 Okt 47min

How a Voice Agent Learns the Rhythm of Conversation — Shawn Wen

Tsung-Hsien (Shawn) Wen, CTO of PolyAI, tells Tim Scarfe why voice agents are harder than text agents. Voice adds time, and a good conversation depends on adapting to the person on the line, not just ...

1 Okt 1h 10min

Who Checks a Proof No Human Can Read? — Leo de Moura

Leonardo de Moura created Lean and co-created Z3. ---This episode is sponsored by Parallel.Parallel, where agents find answers: web search, extraction and deep research APIs built for AI agents.Start ...

30 Sep 1h 14min

When AI Research Starts Moving Faster Than Human Research - Zhengyao Jiang

Weco let an AI coding agent rewrite the harness around another agent for eight days: its code, prompts and tools, while the underlying language model stayed fixed. Tim Scarfe asks Weco co-founder Zhen...

26 Sep 43min

How Deep Learning Finally Cracked Messy Tables - Frank Hutter

Frank Hutter, co-founder of Prior Labs, talks about TabPFN, a tabular foundation model that makes predictions in a single forward pass, and the research behind it.TabPFN is pre-trained on synthetic da...

23 Sep 1h 53min

Why Scaling Prediction Cannot Create Intelligence - Alexander Mattick

Alexander Mattick is a researcher at Fraunhofer IIS and a PhD researcher at the University of Technology Nuremberg (UTN), and a regular on Yannic Kilcher's Discord. He first came on MLST in 2022, afte...

21 Sep 2h 14min

How Physical AI Learns Across Language, Video and Action — Ming-Yu Liu

The car making a left turn at the start of this episode was never filmed. Cosmos 3 generated it. Ming-Yu Liu, who leads the Cosmos research at NVIDIA, explains how one model can describe a video, gene...

15 Sep 25min

Speech Recognition Is Not a Solved Problem — Pavan Kumar Reddy

Pavan Kumar Reddy leads audio research at Mistral AI. He joins Tim Scarfe for a deep technical tour of Voxtral — and explains why the frontier of deployed voice is still a cascade of specialised model...

14 Sep 1h 42min