Gradient Dissent: Conversations on AI1 Des 2022

D. Sculley — Technical Debt, Trade-offs, and Kaggle

D. Sculley is CEO of Kaggle, the beloved and well-known data science and machine learning community.

D. discusses his influential 2015 paper "Machine Learning: The High Interest Credit Card of Technical Debt" and what the current challenges of deploying models in the real world are now, in 2022. Then, D. and Lukas chat about why Kaggle is like a rain forest, and about Kaggle's historic, current, and potential future roles in the broader machine learning community.

Show notes (transcript and links): http://wandb.me/gd-d-sculley

---

⏳ Timestamps:

0:00 Intro

1:02 Machine learning and technical debt

11:18 MLOps, increased stakes, and realistic expectations

19:12 Evaluating models methodically

25:32 Kaggle's role in the ML world

33:34 Kaggle competitions, datasets, and notebooks

38:49 Why Kaggle is like a rain forest

44:25 Possible future directions for Kaggle

46:50 Healthy competitions and self-growth

48:44 Kaggle's relevance in a compute-heavy future

53:49 AutoML vs. human judgment

56:06 After a model goes into production

1:00:00 Outro

---

Connect with D. and Kaggle:

📍 D. on LinkedIn: https://www.linkedin.com/in/d-sculley-90467310/

📍 Kaggle on Twitter: https://twitter.com/kaggle

---

Links:

📍 "Machine Learning: The High Interest Credit Card of Technical Debt" (Sculley et al. 2014): https://research.google/pubs/pub43146/

---

💬 Host: Lukas Biewald

📹 Producers: Riley Fields, Angelica Pan, Anish Shah, Lavanya Shukla

---

Subscribe and listen to our podcast today!

👉 Apple Podcasts: http://wandb.me/apple-podcasts

👉 Google Podcasts: http://wandb.me/google-podcasts

👉 Spotify: http://wandb.me/spotify

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(136)

Uber, Nissan, and Mercedes Chose This Self-Driving Startup | Alex Kendall, Wayve

"Every vehicle is capable of driverless operation. That's clearly the steady state of where we're going."Wayve started in a rented house in Cambridge with $1.5M, a car in the garage, and an aim to int...

15 Apr 45min

Why Netflix, Uber, and Spotify Never Lag: The Database Nobody Talks About | Aaron Katz

"Companies designing for agents, not humans, are going to get a lot of lift."ClickHouse started as an internal tool at Yandex. Today it's the database Anthropic, OpenAI, Meta and Tesla all run on.In t...

31 Mar 43min

The $64M Bet on an AI That Has to Be Right | Carina Hong, CEO of Axiom

Formal verification already consumes years of human effort.In this episode, Lukas Biewald talks with Carina Hong, Founder & CEO of Axiom, about why verification is becoming the real bottleneck in high...

5 Feb 50min

What a $42B Software Co. Really Spends on AI Tools

“I don't worry about being replaced by AI. I worry about being replaced by someone who's really good at using AI.”Atlassian has 10,000+ engineers currently split-testing the world’s top AI coding tool...

20 Jan 1h 7min

Inside the $41B AI Cloud Challenging Big Tech | CoreWeave SVP

The future of AI training is shaped by one constraint: keeping GPUs fed.In this episode, Lukas Biewald talks with CoreWeave SVP Corey Sanders about why general-purpose clouds start to break down under...

6 Jan 53min

Why Physical AI Needed a Completely New Data Stack

The future of AI is physical. In this episode, Lukas Biewald talks to Nikolaus West, CEO of Rerun, about why the breakthrough required to get AI out of the lab and into the messy real world is blocked...

16 Des 20251h

The Engineering Behind the World’s Most Advanced Video AI

Is video AI a viable path toward AGI? Runway ML founder Cristóbal Valenzuela joins Lukas Biewald just after Gen 4.5 reached the #1 position on the Video Arena Leaderboard, according to community votin...

1 Des 202514min

The CEO Behind the Fastest-Growing AI Inference Company | Tuhin Srivastava

In this episode of Gradient Dissent, Lukas Biewald talks with Tuhin Srivastava, CEO and founder of Baseten, one of the fastest-growing companies in the AI inference ecosystem. Tuhin shares the real st...

18 Nov 202559min