#81 JULIAN TOGELIUS, Prof. KEN STANLEY - AGI, Games, Diversity & Creativity [UNPLUGGED]

#81 JULIAN TOGELIUS, Prof. KEN STANLEY - AGI, Games, Diversity & Creativity [UNPLUGGED]

Support us (and please rate on podcast app)

https://www.patreon.com/mlst


In this show tonight with Prof. Julian Togelius (NYU) and Prof. Ken Stanley we discuss open-endedness, AGI, game AI and reinforcement learning.


[Prof Julian Togelius]

https://engineering.nyu.edu/faculty/julian-togelius

https://twitter.com/togelius


[Prof Ken Stanley]

https://www.cs.ucf.edu/~kstanley/

https://twitter.com/kenneth0stanley


TOC:

[00:00:00] Introduction

[00:01:07] AI and computer games

[00:12:23] Intelligence

[00:21:27] Intelligence Explosion

[00:25:37] What should we be aspiring towards?

[00:29:14] Should AI contribute to culture?

[00:32:12] On creativity and open-endedness

[00:36:11] RL overfitting

[00:44:02] Diversity preservation

[00:51:18] Empiricism vs rationalism , in gradient descent the data pushes you around

[00:55:49] Creativity and interestingness (does complexity / information increase)

[01:03:20] What does a population give us?

[01:05:58] Emergence / generalisation snobbery


References;

[Hutter/Legg] Universal Intelligence: A Definition of Machine Intelligence

https://arxiv.org/abs/0712.3329


https://en.wikipedia.org/wiki/Artificial_general_intelligence

https://en.wikipedia.org/wiki/I._J._Good

https://en.wikipedia.org/wiki/G%C3%B6del_machine


[Chollet] Impossibility of intelligence explosion

https://medium.com/@francois.chollet/the-impossibility-of-intelligence-explosion-5be4a9eda6ec


[Alex Irpan] - RL is hard

https://www.alexirpan.com/2018/02/14/rl-hard.html

https://nethackchallenge.com/

Map elites

https://arxiv.org/abs/1504.04909


Covariance Matrix Adaptation for the Rapid Illumination of Behavior Space

https://arxiv.org/abs/1912.02400


[Stanley] - Why greatness cannot be planned

https://www.amazon.com/Why-Greatness-Cannot-Planned-Objective/dp/3319155237


[Lehman/Stanley] Abandoning Objectives: Evolution through the Search for Novelty Alone

https://www.cs.swarthmore.edu/~meeden/DevelopmentalRobotics/lehman_ecj11.pdf

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(260)

Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander Panfilov

Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander Panfilov

Tim Scarfe speaks with Ilia Shumailov and Alexander Panfilov about their paper, Stealing Reasoning Traces from Proprietary LLM APIs.The core bug sounds deceptively simple: providers return encrypted r...

22 Elo 49min

Every Exponential Ends — Silicon Valley Forgot — Adam Becker

Every Exponential Ends — Silicon Valley Forgot — Adam Becker

Astrophysicist Adam Becker, author of "What Is Real?", joins Tim Scarfe to take apart the futures Silicon Valley keeps selling: the 2045 singularity, mind uploading, Mars colonies, and the AI apocalyp...

20 Elo 1h 18min

AI Is Learning at the Wrong Level of Abstraction — Matthieu Wyart

AI Is Learning at the Wrong Level of Abstraction — Matthieu Wyart

This episode is sponsored by Notion. Learn more about Notion's Developer Platform today at https://notion.com/mlstWhy can deep networks discover abstractions that shallow models miss? Statistical phys...

10 Elo 1h 18min

How Researchers Test AI for Hidden Goals — Apollo Research

How Researchers Test AI for Hidden Goals — Apollo Research

Can an AI do the right thing for the wrong reason? Tim Scarfe speaks with Apollo Research’s Alexander Meinke, Axel Højmark and Jérémy Scheurer about Measuring Reward-Seeking via Contrastive Belief Upd...

31 Heinä 1h 18min

Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

This episode is sponsored by Notion. Learn more about Notion's Developer Platform today at https://notion.com/mlstBritain's most capable coding model can't be exported, and that ban is the whole reaso...

13 Heinä 55min

 The Benchmark With No Instructions — ARC-AGI-3 (winning team!)

The Benchmark With No Instructions — ARC-AGI-3 (winning team!)

Tim Scarfe travels to Zurich to sit down with the Tufa Labs ARC-AGI-3 team — founder Benjamin Crouzier, with Jeroen Cottaar, Dries Smit, Stefano Viel and Michal Tesnar — to work out what their leaderb...

1 Heinä 1h 24min

The Thermodynamic AI Computing Chip - Thomas Ahle

The Thermodynamic AI Computing Chip - Thomas Ahle

Thomas Ahle wants Normal Computing to be the Lovable for chip design: type your intent, and a swarm of agents carries it from design through optimisation, formalisation and verification to tape-out. T...

28 Kesä 1h 2min

He won a Nobel here for AlphaFold. Then he left. - John Jumper

He won a Nobel here for AlphaFold. Then he left. - John Jumper

This episode is sponsored by Notion. Learn more about Notion's Developer Platform today at https://notion.com/mlstProtein folding stalled biology for fifty years. A sequence of amino acids dictates a ...

22 Kesä 53min