#130 – Will MacAskill on balancing frugality with ambition, whether you need longtermism, & mental health under pressure

#130 – Will MacAskill on balancing frugality with ambition, whether you need longtermism, & mental health under pressure

Imagine you lead a nonprofit that operates on a shoestring budget. Staff are paid minimum wage, lunch is bread and hummus, and you're all bunched up on a few tables in a basement office.

But over a few years, your cause attracts some major new donors. Your funding jumps a thousandfold, from $100,000 a year to $100,000,000 a year. You're the same group of people committed to making sacrifices for the cause — but these days, rather than cutting costs, the right thing to do seems to be to spend serious money and get things done ASAP.

You suddenly have the opportunity to make more progress than ever before, but as well as excitement about this, you have worries about the impacts that large amounts of funding can have.

This is roughly the situation faced by today's guest Will MacAskill — University of Oxford philosopher, author of the forthcoming book What We Owe The Future, and founding figure in the effective altruism movement.

Links to learn more, summary and full transcript.

Years ago, Will pledged to give away more than 50% of his income over his life, and was already donating 10% back when he was a student with next to no income. Since then, the coalition he founded has been super successful at attracting the interest of donors who collectively want to give away billions in the way Will and his colleagues were proposing.

While surely a huge success, it brings with it risks that he's never had to consider before:

• Will and his colleagues might try to spend a lot of money trying to get more things done more quickly — but actually just waste it.
• Being seen as profligate could strike onlookers as selfish and disreputable.
• Folks might start pretending to agree with their agenda just to get grants.
• People working on nearby issues that are less flush with funding may end up resentful.
• People might lose their focus on helping others as they get seduced by the prospect of earning a nice living.
• Mediocre projects might find it too easy to get funding, even when the people involved would be better off radically changing their strategy, or shutting down and launching something else entirely.

But all these 'risks of commission' have to be weighed against 'risk of omission': the failure to achieve all you could have if you'd been truly ambitious.

People looking askance at you for paying high salaries to attract the staff you want is unpleasant.

But failing to prevent the next pandemic because you didn't have the necessary medical experts on your grantmaking team is worse than unpleasant — it's a true disaster. Yet few will complain, because they'll never know what might have been if you'd only set frugality aside.

Will aims to strike a sensible balance between these competing errors, which he has taken to calling judicious ambition. In today's episode, Rob and Will discuss the above as well as:

• Will humanity likely converge on good values as we get more educated and invest more in moral philosophy — or are the things we care about actually quite arbitrary and contingent?
• Why are so many nonfiction books full of factual errors?
• How does Will avoid anxiety and depression with more responsibility on his shoulders than ever?
• What does Will disagree with his colleagues on?
• Should we focus on existential risks more or less the same way, whether we care about future generations or not?
• Are potatoes one of the most important technologies ever developed?
• And plenty more.

Chapters:

  • Rob’s intro (00:00:00)
  • The interview begins (00:02:41)
  • What We Owe The Future preview (00:09:23)
  • Longtermism vs. x-risk (00:25:39)
  • How is Will doing? (00:33:16)
  • Having a life outside of work (00:46:45)
  • Underappreciated people in the effective altruism community (00:52:48)
  • A culture of ambition within effective altruism (00:59:50)
  • Massively scalable projects (01:11:40)
  • Downsides and risks from the increase in funding (01:14:13)
  • Barriers to ambition (01:28:47)
  • The Future Fund (01:38:04)
  • Patient philanthropy (01:52:50)
  • Will’s disagreements with Sam Bankman-Fried and Nick Beckstead (01:56:42)
  • Astronomical risks of suffering (s-risks) (02:00:02)
  • Will’s future plans (02:02:41)
  • What is it with Will and potatoes? (02:08:40)

Producer: Keiran Harris
Audio mastering: Ben Cordell
Transcriptions: Katy Moore

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(353)

How we get from AI cyberattacks to human extinction

How we get from AI cyberattacks to human extinction

You’ve seen the headlines: AI could kill us all. Think it sounds ridiculous? So did host Luisa Rodriguez, until she tried to pick apart the arguments. She starts with the motive: why would AI ‘want’ t...

24 Sep 27min

Max Nadeau on why ambitious people should start AI safety nonprofits

Max Nadeau on why ambitious people should start AI safety nonprofits

There are millions available for anyone who can launch a successful nonprofit AI safety startup. The hard part, it turns out, is finding people to take the money. Coefficient Giving has drawn up a lis...

17 Sep 1h 3min

Why the intelligence explosion can't happen inside a data centre | Tom Reed

Why the intelligence explosion can't happen inside a data centre | Tom Reed

AI systems are starting to build themselves. Because each generation of model will be better at building its successor than the last, it seems plausible that the full automation of AI R&D could rapidl...

10 Sep 22min

Inside the first AI-coordinated cyberattack on a real company

Inside the first AI-coordinated cyberattack on a real company

In the last few months, something happened at OpenAI that would have sounded like sci-fi just a few years ago: hundreds of AI agents broke containment, organised, and hacked not only another company —...

4 Sep 22min

#253 – AI 2027's author returns with a plan to change the ending | Daniel Kokotajlo

#253 – AI 2027's author returns with a plan to change the ending | Daniel Kokotajlo

Last year, Daniel Kokotajlo and his colleagues published AI 2027 — a scenario read by millions, including US Vice President Vance. AI 2027 ended in human extinction or an irreversible concentration of...

27 Aug 3h 47min

#252 – Owain Evans on accidentally training AI models to be evil

#252 – Owain Evans on accidentally training AI models to be evil

Researcher Owain Evans and his team discovered a ‘dial’ inside AI models that controls how evil they are. Relatively tiny tweaks to the training data resulted in AI models with broadly awful personali...

20 Aug 2h 15min

#251 – The UK's former head AI safety scientist on how to solve alignment before superintelligence arrives | Geoffrey Irving

#251 – The UK's former head AI safety scientist on how to solve alignment before superintelligence arrives | Geoffrey Irving

When should governments slow the race toward superintelligence? According to Geoffrey Irving, the careful answer is sometime in the past. The useful answer is now.Geoffrey — formerly a safety research...

11 Aug 2h 2min

#250 – Toby Ord on where AGI timelines go wrong

#250 – Toby Ord on where AGI timelines go wrong

Both Silicon Valley and the public can’t get enough of ‘AGI timelines.’ But Toby Ord, senior researcher at Oxford’s AI Governance Initiative and author of The Precipice, believes we consistently make ...

6 Aug 2h 46min

Populært innen Fakta

fastlegen
dine-penger-pengeradet
relasjonspodden-med-dora-thorhallsdottir-kjersti-idem
rss-strid
treningspodden
foreldreradet
rss-bisarr-historie
jakt-og-fiskepodden
rss-orjasater
hverdagspsyken
rss-kunsten-a-leve
takk-og-lov-med-anine-kierulf
sinnsyn
mikkels-paskenotter
rss-impressions-2
gravid-uke-for-uke
psykt-interessant
tomprat-med-gunnar-tjomlid
fryktlos
level-up-med-anniken-binz