Good Search Borrows, Great Search … Steals?
Uncanny Valley | WIRED20 Kesä 2024

Good Search Borrows, Great Search … Steals?

Web crawling—the act of indexing information across the internet—has been around for decades. It has primarily been used by search engines like Google and nonprofits like Internet Archive and Common Crawl to catalog the contents of the open internet and make it searchable. Until recently, the practice of web crawling has rarely been seen as controversial, as websites depended on the process as a way for people to find their content. But now crawling tech has been subsumed by the great AI-ening of everything, and is being used by companies like Google and Perplexity AI to absorb whole articles that are fed into their summarizing machines.

This week on Gadget Lab, WIRED senior writer Kate Knibbs joins the show to talk about web crawling and the controversy over Common Crawl. Then we talk with Forbes’ chief content officer and editor Randall Lane about how Perplexity.AI repurposed a Forbes article and presented it as its own story, without first asking permission or properly citing the source.

Show Notes:

Read Kate’s story about how publishers are going after Common Crawl over AI training data. Read Randall’s story about how Preplexity.AI copied the work of two Forbes reporters.

Recommendations:

Randall recommends his new horse racing league, the National Thoroughbred League. Kate recommends the book Victim by Andrew Boryga. Lauren recommends the show Hacks on Max.

Randall Lane can be found on social media @RandallLane. Kate Knibbs is @Knibbs. Lauren Goode is @LaurenGoode. Michael Calore is @snackfight. Bling the main hotline at @GadgetLab. The show is produced by Boone Ashworth (@booneashworth). Our theme music is by Solar Keys.

Learn about your ad choices: dovetail.prx.org/ad-choices

Jaksot(431)

BIG INTV: Margaret Atwood on Doomscrolling: ‘I Want to Keep Up With the Latest Doom’

BIG INTV: Margaret Atwood on Doomscrolling: ‘I Want to Keep Up With the Latest Doom’

On this week’s episode of The Big Interview, the author of The Handmaid’s Tale, Margaret Atwood talks about Elon Musk, political resistance, and why she still has hope for America’s future.Join WIRED’...

6 Tammi 54min

BIG INTV: CTO Elizabeth Stone On The Future of Netflix: “Personalized, Interactive, Immersive”

BIG INTV: CTO Elizabeth Stone On The Future of Netflix: “Personalized, Interactive, Immersive”

Netflix CTO Elizabeth Stone is an anomaly. Instead of coding, she spent her twenties getting a PhD in economics. She quietly rose through the ranks in Silicon Valley and is now responsible for leading...

23 Joulu 202542min

WIRED Roundup: The Five Tech and Politics Trends That Shaped 2025

WIRED Roundup: The Five Tech and Politics Trends That Shaped 2025

For better or for worse, this year had it all — from the AI industry shaping the global economy and our lives, to the so-called Department of Government Efficiency (DOGE) taking over U.S federal agenc...

19 Joulu 202531min

Introducing A New Chapter for Uncanny Valley

Introducing A New Chapter for Uncanny Valley

As the year draws to an end, Mike and Lauren have some news to share with listeners. But first, they head over to the pool to unwind and reflect on what they’ll be watching for in the tech space this ...

18 Joulu 202525min

BIG INTV: AWS CEO Matt Garman Doesn’t Think AI Should Replace Junior Devs

BIG INTV: AWS CEO Matt Garman Doesn’t Think AI Should Replace Junior Devs

The head of Amazon Web Services has big plans to offer AI tools to businesses, but says that replacing coders with AI is “a non-starter for anyone who's trying to build a long-term company.” Katie sit...

16 Joulu 202545min

WIRED Roundup: Making Art In the AI Era, With Wicked’s Jon. M Chu

WIRED Roundup: Making Art In the AI Era, With Wicked’s Jon. M Chu

You don’t have to be a fan of musicals to know about the Wicked film franchise — it’s been everywhere since the first film launched last year, and that’s exactly how director Jon. M Chu wanted it. At ...

12 Joulu 202526min

AMD CEO Lisa Su Isn’t Afraid of the Competition

AMD CEO Lisa Su Isn’t Afraid of the Competition

Last week, some of the most forward-thinking minds in tech, culture, and politics came together for WIRED’s Big Interview event — a series of live, in-depth conversations with industry leaders. To kic...

11 Joulu 202547min

BIG INTV: San Francisco Mayor Daniel Lurie: ‘We Are a City on the Rise’

BIG INTV: San Francisco Mayor Daniel Lurie: ‘We Are a City on the Rise’

Since taking office, San Francisco’s mayor has been on a quest to revitalize the city and increase public safety. He’s also kept the National Guard out—with a little help from some very powerful frien...

9 Joulu 202531min