Why Your Notebook Breaks at 2 AM — Fabric Notebooks

Why Your Notebook Breaks at 2 AM — Fabric Notebooks

Fabric Notebooks: When Interactive Spark Meets Production Reality

Episode 3 • 2026-01-16 Duration: 11:26

Matthias and Fabia dig into Fabric Notebooks — the code-first data engineering workhorse. They cover starter pools vs. custom environments, the new native Python mode, the notebook-to-production gap, and why your notebook that runs perfectly at 2pm crashes in the pipeline at 2am.

What we discuss

  • A real-world mistake from a pre-Fabric era
  • The one question that reframes the architectural debate
  • How we got here — predecessor products and evolution
  • Why the "obvious" answer is often wrong
  • A real Reddit/Microsoft Q&A question unpacked
  • The concrete recommended architecture
  • F-SKU realism — what this actually costs
  • When the rejected approach is actually right
  • Risks of the recommended path
  • What Microsoft is shipping that changes the calculus
  • The architectural principle to take home

Key takeaways

  • Completely fair. And I'll go further — I've seen teams spin up Spark to process ten megabytes of CSV. That's like renting a crane to hang a picture frame. If your transformation is row-level, SQL-expressible, and under a gig? A warehouse...
  • Nope. It's one or the other. And your team will absolutely discover this at the worst possible moment — usually during a demo. The play is: develop and explore on starter pools, switch to a custom Environment only for final testing and...
  • And teams do exactly that. Until they need great_expectations, or dbt-core, or some internal package. Starter pools give you the default library set — pandas, scikit-learn, plotly, the usual. But the moment you need anything custom, you...

Watch the episode

The Fabric Friday video on this topic: https://youtu.be/FUAQZEhQtFI

Resources

About the show

Built on ElevenLabs voice synthesis. Matthias — cloned voice. Fabia — designed AI co-host. See Matthias live on YouTube (Fabric Friday), at his meetups, and at conferences like FabCon.

Hosted by Matthias Falland — Microsoft Data Platform MVP and community architect behind the Fabric Periodic Table. New episodes every Friday.

Submit your case

Have an architecture decision you are wrestling with? DM Matthias on LinkedIn — find him as Matthias Falland. Three to five sentences about the decision, your team size, and your current stack. We anonymize before airing.

Built on ElevenLabs voice synthesis. Brand design based on fabricperiodictable.com.

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(43)

A Label Is Not a Lock

A Label Is Not a Lock

A Label Is Not a Lock Episode 43 • 2026-10-30 Duration: 9:02 A sensitivity label says Highly Confidential in the header, but inside Fabric it never decides who opens the item. This episode traces wher...

30 Loka 9min

Five Thousand Files From a Blank Report

Five Thousand Files From a Blank Report

Five Thousand Files From a Blank Report Episode 42 • 2026-10-23 Duration: 10:17 Medallion is the recommended design approach for Fabric. It's also one building block out of five, and the one that send...

23 Loka 10min

Five Doors and One Credential

Five Doors and One Credential

Five Doors and One Credential Episode 41 • 2026-09-18 Duration: 8:45 Databricks and Fabric have five integration paths, not one. Each moves data. None moves permissions. We pull apart the one-credenti...

22 Loka 8min

Throttled by Yesterday's Refresh

Throttled by Yesterday's Refresh

Throttled by Yesterday's Refresh Episode 37 • 2026-10-16 Duration: 9:21 Fabric doesn't charge you when work happens — it spreads the cost forward into 2,880 thirty-second timepoints. That one sentence...

16 Loka 9min

Your Domain Isn't a Wall

Your Domain Isn't a Wall

Your Domain Isn't a Wall Episode 38 • 2026-10-09 Duration: 8:43 Fabric domains look like governance boundaries but the documentation says otherwise. We unpack what a domain actually gives you, the def...

9 Loka 8min

Where Do the Columns Come From?

Where Do the Columns Come From?

Where Do the Columns Come From? Episode 40 • 2026-09-25 Duration: 9:19 Cosmos DB has no schema. Delta tables need one. When mirroring bridges the two, the replicator guesses — and the guess only ever ...

6 Loka 9min

The Permission Split Inside Read-Only

The Permission Split Inside Read-Only

The Permission Split Inside Read-Only Episode 36 • 2026-10-02 Duration: 8:03 A workspace carries four boundaries — security, cost, region, lifecycle — and you configured one of them. This episode pull...

4 Syys 8min

The Snapshot Locked in a Room

The Snapshot Locked in a Room

The Snapshot Locked in a Room Episode 35 • 2026-08-28 Duration: 8:42 Graph in Fabric materializes a second copy of your data for traversal. That copy explains the staleness, the rebuild cycle, and the...

28 Elo 8min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
vallattomat
mimmit-sijoittaa
rss-rahapodi
rss-oivalluksia-rahasta-elamasta
psykopodiaa-podcast
rss-sami-miettinen-neuvottelija
rss-inderes
rss-laakispodi
ostan-asuntoja-podcast
yrittaja
leadcast
rss-paasipodi
rss-pelastetaan-strategia
rss-hereilla
rss-yritys-ja-erehdys
rss-porssipodi
rss-rahamania
rss-tarkeista-asioista-2
rss-40-ajatusta-aanesta