#109 – Holden Karnofsky on the most important century

#109 – Holden Karnofsky on the most important century

Will the future of humanity be wild, or boring? It's natural to think that if we're trying to be sober and measured, and predict what will really happen rather than spin an exciting story, it's more likely than not to be sort of... dull.

But there's also good reason to think that that is simply impossible. The idea that there's a boring future that's internally coherent is an illusion that comes from not inspecting those scenarios too closely.

At least that is what Holden Karnofsky — founder of charity evaluator GiveWell and foundation Open Philanthropy — argues in his new article series titled 'The Most Important Century'. He hopes to lay out part of the worldview that's driving the strategy and grantmaking of Open Philanthropy's longtermist team, and encourage more people to join his efforts to positively shape humanity's future.

Links to learn more, summary and full transcript.

The bind is this. For the first 99% of human history the global economy (initially mostly food production) grew very slowly: under 0.1% a year. But since the industrial revolution around 1800, growth has exploded to over 2% a year.

To us in 2020 that sounds perfectly sensible and the natural order of things. But Holden points out that in fact it's not only unprecedented, it also can't continue for long.

The power of compounding increases means that to sustain 2% growth for just 10,000 years, 5% as long as humanity has already existed, would require us to turn every individual atom in the galaxy into an economy as large as the Earth's today. Not super likely.

So what are the options? First, maybe growth will slow and then stop. In that case we today live in the single miniscule slice in the history of life during which the world rapidly changed due to constant technological advances, before intelligent civilization permanently stagnated or even collapsed. What a wild time to be alive!

Alternatively, maybe growth will continue for thousands of years. In that case we are at the very beginning of what would necessarily have to become a stable galaxy-spanning civilization, harnessing the energy of entire stars among other feats of engineering. We would then stand among the first tiny sliver of all the quadrillions of intelligent beings who ever exist. What a wild time to be alive!

Isn't there another option where the future feels less remarkable and our current moment not so special?

While the full version of the argument above has a number of caveats, the short answer is 'not really'. We might be in a computer simulation and our galactic potential all an illusion, though that's hardly any less weird. And maybe the most exciting events won't happen for generations yet. But on a cosmic scale we'd still be living around the universe's most remarkable time.

Holden himself was very reluctant to buy into the idea that today’s civilization is in a strange and privileged position, but has ultimately concluded "all possible views about humanity's future are wild".

In the conversation Holden and Rob cover each part of the 'Most Important Century' series, including:

• The case that we live in an incredibly important time
• How achievable-seeming technology - in particular, mind uploading - could lead to unprecedented productivity, control of the environment, and more
• How economic growth is faster than it can be for all that much longer
• Forecasting transformative AI
• And the implications of living in the most important century

Get this episode by subscribing to our podcast on the world’s most pressing problems and how to solve them: type 80,000 Hours into your podcasting app.

Producer: Keiran Harris
Audio mastering: Ben Cordell
Transcriptions: Sofia Davis-Fogel

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(367)

Your AI crash course starts here: Our best episodes to get up to speed on transformative AI

Your AI crash course starts here: Our best episodes to get up to speed on transformative AI

We make a lot of episodes about AI these days. We recently picked out the best 10 episodes of the show to really help deepen your understanding of AI and AGI and superintelligence and recursive self-i...

6 Marras 1min

An AI disaster hits. The president calls Xi. Then what? | Jeremie Harris (crosspost from NonZero)

An AI disaster hits. The president calls Xi. Then what? | Jeremie Harris (crosspost from NonZero)

This is an (unpaid) cross-post of an episode from the podcast NonZero, which Rob Wiblin thought you might be interested in. The originals are on the NonZero website: Part 1 and Part 2. If you like it ...

5 Marras 2h 22min

3 new scandals show being a pain in the ass for AI labs is a legit job now | Rob Wiblin

3 new scandals show being a pain in the ass for AI labs is a legit job now | Rob Wiblin

The big 3 AI companies all had serious scandals last month. Anthropic pushed a federal AI bill that would make it harder to stop dangerous model training. OpenAI fired three safety researchers based o...

3 Marras 29min

Luke Muehlhauser on the most important AI safety work nobody is doing

Luke Muehlhauser on the most important AI safety work nobody is doing

The US government spends 25 times more on military marching bands than on its AI safety institute. And that’s just one of the many institutions we’re missing as AI becomes more powerful and dangerous....

29 Loka 2h 36min

Why Silicon Valley can’t slow down AI on its own | Luisa Rodriguez

Why Silicon Valley can’t slow down AI on its own | Luisa Rodriguez

Two-thirds of Americans think AI is moving too fast. So do the people building it. So why the hell isn’t anyone slowing down?We can’t tell when models are too dangerous. We mostly don’t know how they ...

27 Loka 21min

#257 – Tom Milton on how we could verify a US–China deal on AI

#257 – Tom Milton on how we could verify a US–China deal on AI

If the US and China agreed to pause frontier AI training, how would either side confirm the other was complying? Today, Tom Milton argues, the most likely answer would be to shut down data centres ent...

23 Loka 1h 48min

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

I have a plea for all staff at AI companies: reassess if your current role is still your best opportunity for impact. And if it’s not — move.Frontier lab staff listening to this show will mostly alrea...

21 Loka 14min

Introducing our new YouTube channel: Zershaaneh Talks AI

Introducing our new YouTube channel: Zershaaneh Talks AI

Our host Zershaaneh Qureshi has just launched a new YouTube channel: Zershaaneh Talks AI — featuring conversations about who should control AI, how to control AI, and who gets the benefits.The first e...

20 Loka 1min

Suosittua kategoriassa Koulutus

rss-murhan-anatomia
aamukahvilla
psykopodiaa-podcast
voi-hyvin-meditaatiot-2
rss-arkea-ja-aurinkoa-podcast-espanjasta
rss-hereilla
rss-suomen-aa-podcast
kesken
aloita-meditaatio
adhd-podi
rss-niinku-asia-on
rss-taysi-voima
koulu-podcast-2
rss-liian-kuuma-peruna
rahapuhetta
rss-duodecim-lehti
psykologia
rss-luonnollinen-synnytys-podcast
rss-spessu
rss-vapaudu-voimaasi