#118 – Jaime Yassif on safeguarding bioscience to prevent catastrophic lab accidents and bioweapons development

#118 – Jaime Yassif on safeguarding bioscience to prevent catastrophic lab accidents and bioweapons development

If a rich country were really committed to pursuing an active biological weapons program, there’s not much we could do to stop them. With enough money and persistence, they’d be able to buy equipment, and hire people to carry out the work.

But what we can do is intervene before they make that decision.

Today’s guest, Jaime Yassif — Senior Fellow for global biological policy and programs at the Nuclear Threat Initiative (NTI) — thinks that stopping states from wanting to pursue dangerous bioscience in the first place is one of our key lines of defence against global catastrophic biological risks (GCBRs).

Links to learn more, summary and full transcript.

It helps to understand why countries might consider developing biological weapons. Jaime says there are three main possible reasons:

1. Fear of what their adversary might be up to
2. Belief that they could gain a tactical or strategic advantage, with limited risk of getting caught
3. Belief that even if they are caught, they are unlikely to be held accountable

In response, Jaime has developed a three-part recipe to create systems robust enough to meaningfully change the cost-benefit calculation.

The first is to substantially increase transparency. If countries aren’t confident about what their neighbours or adversaries are actually up to, misperceptions could lead to arms races that neither side desires. But if you know with confidence that no one around you is pursuing a biological weapons programme, you won’t feel motivated to pursue one yourself.

The second is to strengthen the capabilities of the United Nations’ system to investigate the origins of high-consequence biological events — whether naturally emerging, accidental or deliberate — and to make sure that the responsibility to figure out the source of bio-events of unknown origin doesn’t fall between the cracks of different existing mechanisms. The ability to quickly discover the source of emerging pandemics is important both for responding to them in real time and for deterring future bioweapons development or use.

And the third is meaningful accountability. States need to know that the consequences for getting caught in a deliberate attack are severe enough to make it a net negative in expectation to go down this road in the first place.

But having a good plan and actually implementing it are two very different things, and today’s episode focuses heavily on the practical steps we should be taking to influence both governments and international organisations, like the WHO and UN — and to help them maximise their effectiveness in guarding against catastrophic biological risks.

Jaime and Rob explore NTI’s current proposed plan for reducing global catastrophic biological risks, and discuss:

• The importance of reducing emerging biological risks associated with rapid technology advances
• How we can make it a lot harder for anyone to deliberately or accidentally produce or release a really dangerous pathogen
• The importance of having multiples theories of risk reduction
• Why Jaime’s more focused on prevention than response
• The history of the Biological Weapons Convention
• Jaime’s disagreements with the effective altruism community
• And much more

And if you might be interested in dedicating your career to reducing GCBRs, stick around to the end of the episode to get Jaime’s advice — including on how people outside of the US can best contribute, and how to compare career opportunities in academia vs think tanks, and nonprofits vs national governments vs international orgs.

Chapters:

  • Rob’s intro (00:00:00)
  • The interview begins (00:02:32)
  • Categories of global catastrophic biological risks (00:05:24)
  • Disagreements with the effective altruism community (00:07:39)
  • Stopping the first person from getting infected (00:11:51)
  • Shaping intent (00:15:51)
  • Verification and the Biological Weapons Convention (00:25:31)
  • Attribution (00:37:15)
  • How to actually implement a new idea (00:50:54)
  • COVID-19: natural pandemic or lab leak? (00:53:31)
  • How much can we rely on traditional law enforcement to detect terrorists? (00:58:20)
  • Constraining capabilities (01:01:24)
  • The funding landscape (01:06:56)
  • Oversight committees (01:14:20)
  • Just winning the argument (01:20:17)
  • NTI’s vision (01:27:39)
  • Suppliers of goods and services (01:33:24)
  • Publishers (01:39:41)
  • Biggest weaknesses of NTI platform (01:42:29)
  • Careers (01:48:31)
  • How people outside of the US can best contribute (01:54:10)
  • Academia vs think tanks vs nonprofits vs government (01:59:21)
  • International cooperation (02:05:40)
  • Best things about living in the US, UK, China, and Israel (02:11:16)


Producer: Keiran Harris
Audio mastering: Ryan Kessler
Transcriptions: Katy Moore

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(359)

How to get into AI safety in 3 months (article reading by career advisor Matt Beard)

How to get into AI safety in 3 months (article reading by career advisor Matt Beard)

The AI safety field has grown by about 30x in the last eight years. Yet it is still in need of more people. Many want to help, but don’t know where to start. As an advisor at 80,000 Hours, Matt Beard ...

15 Okt 18min

OpenAI Security: Controlling Models is Now ‘Hell’ (AI Explained cross-post)

OpenAI Security: Controlling Models is Now ‘Hell’ (AI Explained cross-post)

This is an (unpaid) cross-post of a video from the podcast 'AI Explained', which Rob Wiblin thought you might be interested in.You can find the original on YouTube here. If you like it and want more s...

9 Okt 40min

In 2023 Ajeya Cotra already knew what was coming (classic episode)

In 2023 Ajeya Cotra already knew what was coming (classic episode)

We're rereleasing some of older episodes that seem more relevant than ever with new rogue AI incidents now seemingly announced every day. Ajeya was one of three independent investigators into the Hugg...

8 Okt 2h 46min

19 Astra and 'Hugging Face' details that reveal what's coming next | Rob Wiblin

19 Astra and 'Hugging Face' details that reveal what's coming next | Rob Wiblin

OpenAI’s rogue agent swarm was eventually caught hacking Hugging Face for a simple reason: it wasn’t trying to hide from us at all. What could a swarm that wants to stay hidden get away with?Host Rob ...

2 Okt 20min

The case for giving AI (some) legal rights | Simon Goldstein

The case for giving AI (some) legal rights | Simon Goldstein

It sounds like the worst idea in the world: pay AIs, let them own property, give them rights. But AI ethics and safety researcher Simon Goldstein thinks it might actually be the best way to keep human...

1 Okt 1h 53min

Will AI take power — or will humans use it to take power first? With Katja Grace and Tom Davidson

Will AI take power — or will humans use it to take power first? With Katja Grace and Tom Davidson

In our first-ever debate, we asked two leading AI risk researchers which catastrophe we should fear most: misaligned AI seizing control from humans, or a small group of humans using AI to seize power....

29 Sep 1h 28min

How we get from AI cyberattacks to human extinction

How we get from AI cyberattacks to human extinction

You’ve seen the headlines: AI could kill us all. Think it sounds ridiculous? So did host Luisa Rodriguez, until she tried to pick apart the arguments. She starts with the motive: why would AI ‘want’ t...

24 Sep 27min

#254 – Max Nadeau on why ambitious people should start AI safety nonprofits

#254 – Max Nadeau on why ambitious people should start AI safety nonprofits

There are millions available for anyone who can launch a successful nonprofit AI safety startup. The hard part, it turns out, is finding people to take the money. Coefficient Giving has drawn up a lis...

17 Sep 1h 3min

Populært innen Fakta

fastlegen
dine-penger-pengeradet
fryktlos
rss-kunsten-a-leve
relasjonspodden-med-dora-thorhallsdottir-kjersti-idem
rss-strid
rss-bisarr-historie
treningspodden
foreldreradet
jakt-og-fiskepodden
rss-orjasater
sinnsyn
hverdagspsyken
takk-og-lov-med-anine-kierulf
mikkels-paskenotter
hr-podden-2
dopet
gravid-uke-for-uke
rss-mind-body-podden
rss-var-forste-kaffe