Racism, the criminal justice system, and data science
Linear Digressions7 Kesä 2020

Racism, the criminal justice system, and data science

As protests sweep across the United States in the wake of the killing of George Floyd by a Minneapolis police officer, we take a moment to dig into one of the ways that data science perpetuates and amplifies racism in the American criminal justice system. COMPAS is an algorithm that claims to give a prediction about the likelihood of an offender to re-offend if released, based on the attributes of the individual, and guess what: it shows disparities in the predictions for black and white offenders that would nudge judges toward giving harsher sentences to black individuals. We dig into this algorithm a little more deeply, unpacking how different metrics give different pictures into the “fairness” of the predictions and what is causing its racially disparate output (to wit: race is explicitly not an input to the algorithm, and yet the algorithm gives outputs that correlate with race—what gives?) Unfortunately it’s not an open-and-shut case of a tuning parameter being off, or the wrong metric being used: instead the biases in the justice system itself are being captured in the algorithm outputs, in such a way that a self-fulfilling prophecy of harsher treatment for black defendants is all but guaranteed. Like many other things this week, this episode left us thinking about bigger, systemic issues, and why it’s proven so hard for years to fix what’s broken.

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(331)

KV Cache Fundamentals

KV Cache Fundamentals

The unsung hero of every LLM conversation you've ever had? A clever optimization called the KV cache. Self-attention is computationally brutal — every token attending to every other token means costs ...

2 Marras 24min

AI Inference 101

AI Inference 101

Everyone talks about training the model — the data, the compute, the alignment magic. But what happens after the weights are frozen and millions of users start hammering it with prompts? That's infere...

26 Loka 27min

Back Next Week

Back Next Week

Back Next Week by Katie Malone

19 Loka 18s

Back in Two Weeks

Back in Two Weeks

Back in Two Weeks by Katie Malone

12 Loka 21s

Mechanistic Interpretability: How Researchers Try To See Inside Models

Mechanistic Interpretability: How Researchers Try To See Inside Models

As AI systems grow more powerful, they grow harder to understand — and that tradeoff has never mattered more. Most interpretability tricks give us approximations from the outside, but mechanistic inte...

5 Loka 29min

LLM As A Judge

LLM As A Judge

Labeled data is expensive, slow, and painfully hard to come by — and when you're trying to evaluate whether an AI workflow is actually doing what you want, the problem gets even messier. How do you ju...

28 Syys 30min

The Impact of AI on Podcasting (Harvard Data Science Review Cross-Post)

The Impact of AI on Podcasting (Harvard Data Science Review Cross-Post)

Originally aired on the Harvard Data Science Review podcast. What can podcasting teach us about AI — and what can AI teach us about the future of podcasting? Katie Malone (that's our host) joins Jon ...

21 Syys 29min

Better Know A Benchmark: ExploitGym

Better Know A Benchmark: ExploitGym

When OpenAI's frontier models were caught hacking Hugging Face's servers, most people assumed they were hunting for answer keys. The real story is stranger and more unsettling. Katie and Phoebe unpack...

14 Syys 32min