Good Search Borrows, Great Search … Steals?

Good Search Borrows, Great Search … Steals?

Web crawling—the act of indexing information across the internet—has been around for decades. It has primarily been used by search engines like Google and nonprofits like Internet Archive and Common Crawl to catalog the contents of the open internet and make it searchable. Until recently, the practice of web crawling has rarely been seen as controversial, as websites depended on the process as a way for people to find their content. But now crawling tech has been subsumed by the great AI-ening of everything, and is being used by companies like Google and Perplexity AI to absorb whole articles that are fed into their summarizing machines.

This week on Gadget Lab, WIRED senior writer Kate Knibbs joins the show to talk about web crawling and the controversy over Common Crawl. Then we talk with Forbes’ chief content officer and editor Randall Lane about how Perplexity.AI repurposed a Forbes article and presented it as its own story, without first asking permission or properly citing the source.

Show Notes:

Read Kate’s story about how publishers are going after Common Crawl over AI training data. Read Randall’s story about how Preplexity.AI copied the work of two Forbes reporters.

Recommendations:

Randall recommends his new horse racing league, the National Thoroughbred League. Kate recommends the book Victim by Andrew Boryga. Lauren recommends the show Hacks on Max.

Randall Lane can be found on social media @RandallLane. Kate Knibbs is @Knibbs. Lauren Goode is @LaurenGoode. Michael Calore is @snackfight. Bling the main hotline at @GadgetLab. The show is produced by Boone Ashworth (@booneashworth). Our theme music is by Solar Keys.

Learn about your ad choices: dovetail.prx.org/ad-choices

Jaksot(426)

Iran Targets U.S. Tech; Polymarket’s Bar Flop; Trump's Plans for Midterms

Iran Targets U.S. Tech; Polymarket’s Bar Flop; Trump's Plans for Midterms

The team is back this week to discuss how top U.S tech companies are increasingly finding themselves as targets in the ongoing war with Iran. We also get an inside view into how Polymarket’s pop-up ba...

2 Huhti 27min

The Myth That AI Will Replace Language Learning

The Myth That AI Will Replace Language Learning

Luis von Ahn, Duolingo’s co-founder and CEO, joins Katie to discuss why we should still learn languages in the age of AI translation. He also talks about how Duolingo is dealing with falling share pri...

31 Maalis 47min

Trump's 80s Movie Approach to Foreign Policy w/ Chris Hayes

Trump's 80s Movie Approach to Foreign Policy w/ Chris Hayes

For the first episode of our second season, Katie sits down with fellow journalist Chris Hayes, host of MS NOW’S All In, to talk about covering the news and capturing attention during an all-consuming...

24 Maalis 40min

Nvidia’s “Super Bowl of AI”; Tesla Disappoints Fans; Meta’s VR Metaverse Is Over

Nvidia’s “Super Bowl of AI”; Tesla Disappoints Fans; Meta’s VR Metaverse Is Over

This week, Brian and Zoë discuss the highlights from Nvidia’s annual developer conference, and why Tesla recently got in trouble with some of its most loyal fans online. Plus, Meta’s decision of shutt...

19 Maalis 25min

Uncovering an AI Journalist

Uncovering an AI Journalist

This week we are bringing you a podcast recommendation. A great tech focused weekly show called Kill Switch, hosted by Dexter Thomas. On this episode Dexter goes down a rabbit hole. When an editor at ...

18 Maalis 32min

Can Anthropic Win Its Lawsuit?; War Memes; AI Comes for VCs Jobs

Can Anthropic Win Its Lawsuit?; War Memes; AI Comes for VCs Jobs

This week, the team discusses what’s at stake for Anthropic after the company sued the Department of Defense. They also take a look at the strategy behind the Trump administration sharing action-fille...

12 Maalis 31min

Iran Strikes in the AI Era; Prediction Markets Ethics; Paramount Beats Netflix

Iran Strikes in the AI Era; Prediction Markets Ethics; Paramount Beats Netflix

This week, the team dives into why disinformation and the AI industry battles have quickly positioned themselves at the center of the ongoing conflict between the U.S and Iran. They also discuss how p...

5 Maalis 33min

BIG INTV: Open AI’s Former Safety Lead Calls Out Erotica Claims (Rerun)

BIG INTV: Open AI’s Former Safety Lead Calls Out Erotica Claims (Rerun)

Steven Adler used to lead product safety at OpenAI. When Katie read his recent op-ed asking OpenAI to prove that they have and continue to address safety issues, she knew she wanted to talk to him. Th...

3 Maalis 39min