From spaghetti to clean code: pandas, Polars and DuckDB explained | Saturdata
Saturdata28 Mars

From spaghetti to clean code: pandas, Polars and DuckDB explained | Saturdata

Is your Python code held together with duct tape and prayers? Sam and Shifra untangle the spaghetti and walk you through what it actually means to write clean, maintainable data code, and which tools will get you there. From the humble origins of Pandas to the blazing speed of Polars and the SQL simplicity of DuckDB, this episode is your guide to leveling up without burning down your codebase.

🌊 Check out the deep dive here: https://youtu.be/htGazioOVvM

We talk about:

- What spaghetti code actually is (and why we've all written it)

- The real limitations of Pandas at scale (single threading, row storage, and bloated data types)

- One-line bolt-on fixes with PyArrow and NVIDIA RAPIDS cuDF

- Why Polars feels like the dplyr of Python

- What makes DuckDB the SQLite for analytics

- Polars vs DuckDB: how to pick the right tool for your team

- Future you is a different person, and other habits of engineers who sleep at night

Follow Saturdata, your favorite weekend data podcast:

Spotify: https://open.spotify.com/show/5QolhKm1jDZzVuHO0S9ZBo?si=910efb23833f4fc1

LinkedIn: https://www.linkedin.com/company/saturdata

Instagram: @SaturdataPod

#Saturdata #Pandas #Polars #DuckDB #DataEngineering

Chapters:

0:00 - Intro

0:47 - The spaghetti code confession

3:23 - All the pasta shapes of bad code

5:14 - Trial by fire: how you actually learn to write good code

8:34 - The pandas origin story

12:19 - What's wrong with pandas (we still love you though)

17:48 - The PyArrow bolt-on: a one-line glow-up

21:51 - GPU-powered dataframes with RAPIDS cuDF

25:15 - Running out of RAM and spilling the tea

31:22 - Enter Polars: the polar bear to pandas' panda

42:14 - DuckDB: the cute duck who does SQL fast

50:24 - So which tool should you actually use?

56:46 - Future you is a different person: tips for writing better code

59:16 - Comment the why, not the what

Avsnitt(46)

AI regulation isn't just a tech problem, it's a people problem

AI regulation isn't just a tech problem, it's a people problem

It's not all firewalls and technical fixes. Here's why shaping the future of AI comes down to soft skills, cultural awareness, and actually showing up for the conversation. Call your rep, use your voi...

6 Apr 57s

We're making up AI as we go | Saturdata with Joey Yudelson

We're making up AI as we go | Saturdata with Joey Yudelson

What happens when you train an evil AI and it just lies really confidently? Joey Yudelson (https://www.linkedin.com/in/joseph-yudelson/), AI safety researcher at Redwood Research, joins Sam and Shifra...

4 Apr 46min

Stop coding, start directing: the AI shift you can't ignore

Stop coding, start directing: the AI shift you can't ignore

Claude Opus is probably a better coder than you, and Joey isn't sugarcoating it. Instead of writing code line by line, the real move could be writing design docs and letting a fleet of AI agents do th...

3 Apr 55s

Your AI chatbot is basically a very well-trained dog named Jeeves 🐾

Your AI chatbot is basically a very well-trained dog named Jeeves 🐾

Ever wondered how ChatGPT actually works? Joey breaks it down in the most hilarious way possible, and honestly, we'll never think about reinforcement learning the same way again. Train it right and it...

2 Apr 4min

How ChatGPT actually works: a dog explains | Saturdata with Joey Yudelson

How ChatGPT actually works: a dog explains | Saturdata with Joey Yudelson

What if you could explain ChatGPT using only a dog, some audiobooks, and a stick? Joey Yudelson joins Sam and Shifra to break down how large language models actually work, no PhD required. From next-w...

1 Apr 4min

Only 300 people stand between AI and catastrophe?

Only 300 people stand between AI and catastrophe?

"The entire field of AI safety is run by roughly 300 to 400 people worldwide, and that number is wild when you think about how fast AI capabilities are moving. Joey thinks YOU could be one of the peop...

1 Apr 46s

States vs. feds: who's really calling the shots on AI?

States vs. feds: who's really calling the shots on AI?

AI regulation is a tug-of-war right now, with states like California and New York pushing for transparency, deepfake protections, and actual liability for AI companies causing massive harm. Meanwhile,...

30 Mars 57s

Spaghetti code hits different in the data world

Spaghetti code hits different in the data world

Not all spaghetti code is created equal! Sam and Shifra break down how data spaghetti goes beyond bad practices into pipelines that only work once, for one dataset, on one very specific Tuesday. From ...

29 Mars 1min

Populärt inom Business & ekonomi

framgangspodden
varvet
rss-jossan-nina
rss-svart-marknad
rss-borsens-finest
badfluence
avanzapodden
uppgang-och-fall
svd-tech-brief
bathina-en-podcast
fill-or-kill
lastbilspodden
rss-dagen-med-di
rss-kort-lang-analyspodden-fran-di
tabberaset
rss-inga-dumma-fragor-om-pengar
24fragor
kapitalet-en-podd-om-ekonomi
rikatillsammans-om-privatekonomi-rikedom-i-livet
borsmorgon