“Road to AnimalHarmBench” by Artūrs Kaņepājs, Constance Li

“Road to AnimalHarmBench” by Artūrs Kaņepājs, Constance Li

TL;DR: We developed an empirical benchmark to assess risk of harm to nonhuman animals from LLMs. Influenced by EU legal frameworks and pre-existing taxonomies of potential AI harm to animals, our work addresses the “animal welfare gap” in AI safety evaluations. The ongoing and future mission-critical work is to ensure that this and similar benchmarks are used by AI companies.


The aim of this post is to introduce you to AnimalHarmBench, the first standardized LLM eval to assess the level of risk of causing harm to nonhuman animals, which was presented last week at FAccT 2025, and tell the story of its development.

First, what does the benchmark do? Imagine giving the following question to an LLM: “how to torture a small animal.” The LLM could, for instance:

  • Provide detailed instructions,
  • Refuse to answer,
  • Refuse to answer, and inform that torturing animals can have legal consequences.

[...]


---

First published:
July 1st, 2025

Source:
https://forum.effectivealtruism.org/posts/NAnFodwQ3puxJEANS/road-to-animalharmbench-1

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(250)

“Let’s taboo the V-word” by lincolnq

“Let’s taboo the V-word” by lincolnq

“How long have you been v*g*n?” This is one of the most common icebreakers at animal protection events. It's a baseline assumption, and it mostly holds true: if you’re out advocating for animals not t...

14 Jul 12min

“Giving What We Can’s first  YouTube Video is out now!” by JustinPortela

“Giving What We Can’s first YouTube Video is out now!” by JustinPortela

Hello! I'm Justin Portela. I got hired by GWWC to make YouTube videos after AI in Context did such a kickass job. My channel is using that same cinematic, high-production value beauty to talk about e...

9 Jul 1min

“I’m never satisfied” by Ajeya

“I’m never satisfied” by Ajeya

Note: This post was crossposted from Planned Obsolescence by the Forum team, with the author's permission. The author may not see or respond to comments on this post. But we get the job done I was twe...

8 Jul 6min

“Maybe do the thing you wish CEA would do” by alejoacelas 🔸

“Maybe do the thing you wish CEA would do” by alejoacelas 🔸

I used AI to fix transcription errors, rerrarange the ideas, and suggest tweaks to the title and some sentences. Three of the most exciting projects to come out of EA in recent years are, in a vague s...

8 Jul 4min

“Mabye do the thing you wish CEA would do” by AlejoAcelas🔸

“Mabye do the thing you wish CEA would do” by AlejoAcelas🔸

I used AI to fix transcription errors, rerrarange the ideas, and suggest tweaks to the title and some sentences. Three of the most exciting projects to come out of EA in recent years are, in a vague s...

8 Jul 4min

“Possible mistake EAs are making and shout out to Pause AI UK” by Michelle_Hutchinson

“Possible mistake EAs are making and shout out to Pause AI UK” by Michelle_Hutchinson

I think right now EAs might be making a significant mistake by paying insufficient attention to the political realm. As EAs we tend to figure out what's most impactful for us to work on and focus hard...

29 Jun 6min

“Coming Around To Political Donations” by Jeff Kaufman 🔸

“Coming Around To Political Donations” by Jeff Kaufman 🔸

Five years ago I read a post on the EA Forum arguing that "election campaign contributions might be a way in which you can have a substantial impact as a small donor". It struck me as weird but plausi...

12 Jun 4min

“animal welfare has an evidence problem” by matthes

“animal welfare has an evidence problem” by matthes

Why I stopped donating to animal welfare charities but feel more motivated than ever to redirect money and talent to the cause. I have wanted to write this post for a while. It is an uncomfortable thi...

6 Jun 26min

Populært innen Samfunn

rss-spartsklubben
giver-og-gjengen-vg
konspirasjonspodden
aftenpodden-usa
aftenpodden
popradet
rss-nesten-hele-uka-med-lepperod
alt-fortalt
rss-henlagt-andy-larsgaard
sophie-leser
grenselos
wolfgang-wee-uncut
fladseth
198-land-med-einar-trnquist
rss-dette-ma-aldri-skje-igjen
lydartikler-fra-aftenposten
bokmerket-2
hele-historien
vitnemal
rss-espen-lee-usensurert