#118 – Jaime Yassif on safeguarding bioscience to prevent catastrophic lab accidents and bioweapons development

#118 – Jaime Yassif on safeguarding bioscience to prevent catastrophic lab accidents and bioweapons development

If a rich country were really committed to pursuing an active biological weapons program, there’s not much we could do to stop them. With enough money and persistence, they’d be able to buy equipment, and hire people to carry out the work.

But what we can do is intervene before they make that decision.

Today’s guest, Jaime Yassif — Senior Fellow for global biological policy and programs at the Nuclear Threat Initiative (NTI) — thinks that stopping states from wanting to pursue dangerous bioscience in the first place is one of our key lines of defence against global catastrophic biological risks (GCBRs).

Links to learn more, summary and full transcript.

It helps to understand why countries might consider developing biological weapons. Jaime says there are three main possible reasons:

1. Fear of what their adversary might be up to
2. Belief that they could gain a tactical or strategic advantage, with limited risk of getting caught
3. Belief that even if they are caught, they are unlikely to be held accountable

In response, Jaime has developed a three-part recipe to create systems robust enough to meaningfully change the cost-benefit calculation.

The first is to substantially increase transparency. If countries aren’t confident about what their neighbours or adversaries are actually up to, misperceptions could lead to arms races that neither side desires. But if you know with confidence that no one around you is pursuing a biological weapons programme, you won’t feel motivated to pursue one yourself.

The second is to strengthen the capabilities of the United Nations’ system to investigate the origins of high-consequence biological events — whether naturally emerging, accidental or deliberate — and to make sure that the responsibility to figure out the source of bio-events of unknown origin doesn’t fall between the cracks of different existing mechanisms. The ability to quickly discover the source of emerging pandemics is important both for responding to them in real time and for deterring future bioweapons development or use.

And the third is meaningful accountability. States need to know that the consequences for getting caught in a deliberate attack are severe enough to make it a net negative in expectation to go down this road in the first place.

But having a good plan and actually implementing it are two very different things, and today’s episode focuses heavily on the practical steps we should be taking to influence both governments and international organisations, like the WHO and UN — and to help them maximise their effectiveness in guarding against catastrophic biological risks.

Jaime and Rob explore NTI’s current proposed plan for reducing global catastrophic biological risks, and discuss:

• The importance of reducing emerging biological risks associated with rapid technology advances
• How we can make it a lot harder for anyone to deliberately or accidentally produce or release a really dangerous pathogen
• The importance of having multiples theories of risk reduction
• Why Jaime’s more focused on prevention than response
• The history of the Biological Weapons Convention
• Jaime’s disagreements with the effective altruism community
• And much more

And if you might be interested in dedicating your career to reducing GCBRs, stick around to the end of the episode to get Jaime’s advice — including on how people outside of the US can best contribute, and how to compare career opportunities in academia vs think tanks, and nonprofits vs national governments vs international orgs.

Chapters:

  • Rob’s intro (00:00:00)
  • The interview begins (00:02:32)
  • Categories of global catastrophic biological risks (00:05:24)
  • Disagreements with the effective altruism community (00:07:39)
  • Stopping the first person from getting infected (00:11:51)
  • Shaping intent (00:15:51)
  • Verification and the Biological Weapons Convention (00:25:31)
  • Attribution (00:37:15)
  • How to actually implement a new idea (00:50:54)
  • COVID-19: natural pandemic or lab leak? (00:53:31)
  • How much can we rely on traditional law enforcement to detect terrorists? (00:58:20)
  • Constraining capabilities (01:01:24)
  • The funding landscape (01:06:56)
  • Oversight committees (01:14:20)
  • Just winning the argument (01:20:17)
  • NTI’s vision (01:27:39)
  • Suppliers of goods and services (01:33:24)
  • Publishers (01:39:41)
  • Biggest weaknesses of NTI platform (01:42:29)
  • Careers (01:48:31)
  • How people outside of the US can best contribute (01:54:10)
  • Academia vs think tanks vs nonprofits vs government (01:59:21)
  • International cooperation (02:05:40)
  • Best things about living in the US, UK, China, and Israel (02:11:16)


Producer: Keiran Harris
Audio mastering: Ryan Kessler
Transcriptions: Katy Moore

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(367)

Your AI crash course starts here: Our best episodes to get up to speed on transformative AI

Your AI crash course starts here: Our best episodes to get up to speed on transformative AI

We make a lot of episodes about AI these days. We recently picked out the best 10 episodes of the show to really help deepen your understanding of AI and AGI and superintelligence and recursive self-i...

6 Nov 1min

An AI disaster hits. The president calls Xi. Then what? | Jeremie Harris (crosspost from NonZero)

An AI disaster hits. The president calls Xi. Then what? | Jeremie Harris (crosspost from NonZero)

This is an (unpaid) cross-post of an episode from the podcast NonZero, which Rob Wiblin thought you might be interested in. The originals are on the NonZero website: Part 1 and Part 2. If you like it ...

5 Nov 2h 22min

3 new scandals show being a pain in the ass for AI labs is a legit job now | Rob Wiblin

3 new scandals show being a pain in the ass for AI labs is a legit job now | Rob Wiblin

The big 3 AI companies all had serious scandals last month. Anthropic pushed a federal AI bill that would make it harder to stop dangerous model training. OpenAI fired three safety researchers based o...

3 Nov 29min

Luke Muehlhauser on the most important AI safety work nobody is doing

Luke Muehlhauser on the most important AI safety work nobody is doing

The US government spends 25 times more on military marching bands than on its AI safety institute. And that’s just one of the many institutions we’re missing as AI becomes more powerful and dangerous....

29 Okt 2h 36min

Why Silicon Valley can’t slow down AI on its own | Luisa Rodriguez

Why Silicon Valley can’t slow down AI on its own | Luisa Rodriguez

Two-thirds of Americans think AI is moving too fast. So do the people building it. So why the hell isn’t anyone slowing down?We can’t tell when models are too dangerous. We mostly don’t know how they ...

27 Okt 21min

#257 – Tom Milton on how we could verify a US–China deal on AI

#257 – Tom Milton on how we could verify a US–China deal on AI

If the US and China agreed to pause frontier AI training, how would either side confirm the other was complying? Today, Tom Milton argues, the most likely answer would be to shut down data centres ent...

23 Okt 1h 48min

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

I have a plea for all staff at AI companies: reassess if your current role is still your best opportunity for impact. And if it’s not — move.Frontier lab staff listening to this show will mostly alrea...

21 Okt 14min

Introducing our new YouTube channel: Zershaaneh Talks AI

Introducing our new YouTube channel: Zershaaneh Talks AI

Our host Zershaaneh Qureshi has just launched a new YouTube channel: Zershaaneh Talks AI — featuring conversations about who should control AI, how to control AI, and who gets the benefits.The first e...

20 Okt 1min

Populärt inom Utbildning

husmodern-med-amanda-schulman
historiepodden-se
rss-bara-en-till-om-beroende-medberoende
det-skaver
rosceremoni
nu-blir-det-historia
harrisons-dramatiska-historia
rss-viktmedicinpodden
roda-vita-rosen
rss-dr-bjorklund
allt-du-velat-veta
not-fanny-anymore
sa-in-i-sjalen
sektledare
i-vantan-pa-katastrofen
johannes-hansen-podcast
rss-basta-livet
rss-max-tant-med-max-villman
rss-traningsklubben
sektpodden