#82 - Dr. JOSCHA BACH - Digital Physics, DL and Consciousness [UNPLUGGED]

#82 - Dr. JOSCHA BACH - Digital Physics, DL and Consciousness [UNPLUGGED]

AI Helps Ukraine - Charity Conference

A charity conference on AI to raise funds for medical and humanitarian aid for Ukraine

https://aihelpsukraine.cc/


YT version: https://youtu.be/LgwjcqhkOA4


Support us!

https://www.patreon.com/mlst


Dr. Joscha Bach (born 1973 in Weimar, Germany) is a German artificial intelligence researcher and cognitive scientist focusing on cognitive architectures, mental representation, emotion, social modelling, and multi-agent systems.

http://bach.ai/

https://twitter.com/plinz


TOC:

[00:00:00] Ukraine Charity Conference and NeurIPS 2022

[00:03:40] Theory of computation, Godel, Penrose

[00:11:44] Modelling physical reality

[00:15:19] Is our universe infinite?

[00:24:30] Large language models, and on DL / is Gary Marcus hitting a wall?

[00:45:17] Generative models / Codex / Language of thought

[00:58:46] Consciousness (with Friston references)


References:


Am I Self-Conscious? (Or Does Self-Organization Entail Self-Consciousness?) [Friston]

https://www.frontiersin.org/articles/10.3389/fpsyg.2018.00579/full


Impact of Pretraining Term Frequencies on Few-Shot Reasoning [Yasaman Razeghi]

https://arxiv.org/abs/2202.07206


Deep Learning Is Hitting a Wall [Gary Marcus]

https://nautil.us/deep-learning-is-hitting-a-wall-238440/


Turing machines

https://en.wikipedia.org/wiki/Turing_machine

Lambda Calculus

https://en.wikipedia.org/wiki/Lambda_calculus

Godel's incompletness theorem

https://en.wikipedia.org/wiki/G%C3%B6del%27s_incompleteness_theorems

Oracle machine

https://en.wikipedia.org/wiki/Oracle_machine

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(260)

Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander Panfilov

Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander Panfilov

Tim Scarfe speaks with Ilia Shumailov and Alexander Panfilov about their paper, Stealing Reasoning Traces from Proprietary LLM APIs.The core bug sounds deceptively simple: providers return encrypted r...

22 Elo 49min

Every Exponential Ends — Silicon Valley Forgot — Adam Becker

Every Exponential Ends — Silicon Valley Forgot — Adam Becker

Astrophysicist Adam Becker, author of "What Is Real?", joins Tim Scarfe to take apart the futures Silicon Valley keeps selling: the 2045 singularity, mind uploading, Mars colonies, and the AI apocalyp...

20 Elo 1h 18min

AI Is Learning at the Wrong Level of Abstraction — Matthieu Wyart

AI Is Learning at the Wrong Level of Abstraction — Matthieu Wyart

This episode is sponsored by Notion. Learn more about Notion's Developer Platform today at https://notion.com/mlstWhy can deep networks discover abstractions that shallow models miss? Statistical phys...

10 Elo 1h 18min

How Researchers Test AI for Hidden Goals — Apollo Research

How Researchers Test AI for Hidden Goals — Apollo Research

Can an AI do the right thing for the wrong reason? Tim Scarfe speaks with Apollo Research’s Alexander Meinke, Axel Højmark and Jérémy Scheurer about Measuring Reward-Seeking via Contrastive Belief Upd...

31 Heinä 1h 18min

Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

This episode is sponsored by Notion. Learn more about Notion's Developer Platform today at https://notion.com/mlstBritain's most capable coding model can't be exported, and that ban is the whole reaso...

13 Heinä 55min

 The Benchmark With No Instructions — ARC-AGI-3 (winning team!)

The Benchmark With No Instructions — ARC-AGI-3 (winning team!)

Tim Scarfe travels to Zurich to sit down with the Tufa Labs ARC-AGI-3 team — founder Benjamin Crouzier, with Jeroen Cottaar, Dries Smit, Stefano Viel and Michal Tesnar — to work out what their leaderb...

1 Heinä 1h 24min

The Thermodynamic AI Computing Chip - Thomas Ahle

The Thermodynamic AI Computing Chip - Thomas Ahle

Thomas Ahle wants Normal Computing to be the Lovable for chip design: type your intent, and a swarm of agents carries it from design through optimisation, formalisation and verification to tape-out. T...

28 Kesä 1h 2min

He won a Nobel here for AlphaFold. Then he left. - John Jumper

He won a Nobel here for AlphaFold. Then he left. - John Jumper

This episode is sponsored by Notion. Learn more about Notion's Developer Platform today at https://notion.com/mlstProtein folding stalled biology for fifty years. A sequence of amino acids dictates a ...

22 Kesä 53min