“The case for AI safety capacity-building work” by abergal

“The case for AI safety capacity-building work” by abergal

I work on the capacity-building team on the Global Catastrophic Risks-half of Coefficient Giving (formerly known as Open Philanthropy). Our remit is, roughly, to increase the amount of talent aiming to prevent unprecedented, globally catastrophic events. These days, we’re mostly focused on AI, and we’ve funded a number of projects and grantees that readers of this post might be familiar with– including MATS, BlueDot Impact, Constellation, 80,000 Hours, CEA, the Curve, FAR.AI's events, university groups, and many other workshops and projects.

The post aims to make the case that broadly, capacity-building work (including on AI risk) has been and continues to be extremely impactful, and to encourage people to consider pursuing relevant projects and careers.

This post is written from my personal perspective; that said, my sense is that a number of CG staff and others in the AI safety space share my views. I include some quotes from them at the end of this post.

I’m writing this post partly out of a desire to correct what I perceive as an asymmetry in terms of how excited I and others at Coefficient Giving are about this kind of work vs. how much people in the EA and AI [...]

---

Outline:

(02:15) The case for capacity-building work

(04:11) Surveys

(06:49) Testimonials

(08:21) Neel Nanda (Senior Research Scientist at Google DeepMind)

(11:15) Max Nadeau (Associate Program Officer (Technical AI Safety) at Coefficient Giving)

(12:51) Rachel Weinberg (founder and former head of The Curve, currently at AI Futures Project)

(14:30) Marius Hobbhann (CEO and founder of Apollo Research)

(16:38) Adam Kaufman (member of technical staff at Redwood Research)

(18:10) Gabriel Wu (member of technical staff (alignment) at OpenAI)

(19:37) Catherine Brewer (Senior Program Associate (AI Governance) at Coefficient Giving)

(21:12) Aric Floyd (video host for AI in Context)

(23:12) Ryan Kidd (Director of MATS)

(25:43) What tends to work?

(28:34) Whats good to do now?

(29:31) Who should be doing this work?

(31:02) What would doing this work look like?

(31:13) Working at an organization doing good work in the space

(31:46) Constellation - CEO

(32:46) Kairos - various early generalist positions

(33:42) Starting or running your own capacity-building project or organization

(34:07) Working on a capacity-building project part-time

(34:30) Subscribing to Multiplier, a Substack with thoughts from our team (and other AI grantmaking staff at CG)

(34:39) Letting our team know

(35:03) Social proof

(35:25) Julian Hazell, AI governance and policy at Coefficient Giving

(36:19) Trevor Levin, AI governance and policy at Coefficient Giving

(36:51) Ryan Greenblatt, Chief Scientist at Redwood Research:

(37:21) Buck Shlegeris, CEO of Redwood Research

(39:52) Appendix

---

First published:
March 10th, 2026

Source:
https://forum.effectivealtruism.org/posts/rAqKSSXankvys2Fzu/the-case-for-ai-safety-capacity-building-work

---

Narrated by TYPE III AUDIO.

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(250)

“What if the third wave is a puddle?” by Morgan Fairless

“What if the third wave is a puddle?” by Morgan Fairless

The world of private philanthropy may be in for a period of large growth. News of Coefficient Giving increasing their funding for GiveWell to one billion in the near-term, and the general growth of th...

18 Aug 9min

“What would make us scale or stop? NOVAH’s pre-commitment before seeing the RCT results” by I.J.J., AlexisAt

“What would make us scale or stop? NOVAH’s pre-commitment before seeing the RCT results” by I.J.J., AlexisAt

TL;DR NOVAH (No Violence At Home) was incubated by Charity Entrepreneurship (now Ambitious Impact) in 2024 to test a promising idea: preventing intimate partner violence through edutainment, in our ca...

17 Aug 15min

“General capability - and capabilities generally - have no good y-axis” by Gregory Lewis🔸

“General capability - and capabilities generally - have no good y-axis” by Gregory Lewis🔸

BLUF: To determine whether AI is ‘improving exponentially’, ‘hitting the wall’, or any other claim which involves a quantity or magnitude (e.g. ‘This model was a big leap/small increment’). We need a...

8 Aug 1h 7min

“Never born, then maybe died twice” by NickLaing

“Never born, then maybe died twice” by NickLaing

“Your balls are baked aren’t they, mate”. He would not have been bornThanks Lyndon, that describes the situation. Like almost 1 in 10 modern men, my sperm weren’t up to the task - at least not the old...

1 Aug 10min

“Announcing: Cluelessness Critiques Competition” by Toby Tremlett🔹, Will Aldred

“Announcing: Cluelessness Critiques Competition” by Toby Tremlett🔹, Will Aldred

TL;DR We’re hosting an essay competition to elicit responses to Anthony DiGiovanni's sequence, ‘The challenge of unawareness for impartial altruist action guidance’—submit your entries by August 14th...

30 Juli 13min

“Spiro: an update 2.5 years on and a fundraising ask for expansion” by Habiba Banu

“Spiro: an update 2.5 years on and a fundraising ask for expansion” by Habiba Banu

Summary Back in November 2023 I posted here to launch Spiro and raise our first 198 thousand dollars. Two and a half years later this is an update and a fundraiser for the next step. The short version...

26 Juli 17min

“Let’s taboo the V-word” by lincolnq

“Let’s taboo the V-word” by lincolnq

“How long have you been v*g*n?” This is one of the most common icebreakers at animal protection events. It's a baseline assumption, and it mostly holds true: if you’re out advocating for animals not t...

14 Juli 12min

“Giving What We Can’s first  YouTube Video is out now!” by JustinPortela

“Giving What We Can’s first YouTube Video is out now!” by JustinPortela

Hello! I'm Justin Portela. I got hired by GWWC to make YouTube videos after AI in Context did such a kickass job. My channel is using that same cinematic, high-production value beauty to talk about e...

9 Juli 1min

Populärt inom Samhälle & Kultur

podme-dokumentar
gynning-berg
aftonbladet-krim
en-mork-historia
p3-dokumentar
aftonbladet-daily
hor-har
creepypodden-med-jack-werner
killradet
rss-schyffert-sundin-ar-det-har-nat
flashback-forever
kod-katastrof
rss-nemo-moter-en-van
svenska-fall
vad-blir-det-for-mord
mardromsgasten
rss-vill-du-veta-en-hemlis-2
rss-mer-an-bara-morsa
p3-historia
rss-vad-fan-hande