Why Your Notebook Breaks at 2 AM — Fabric Notebooks

Why Your Notebook Breaks at 2 AM — Fabric Notebooks

Fabric Notebooks: When Interactive Spark Meets Production Reality

Episode 3 • 2026-01-16 Duration: 11:26

Matthias and Fabia dig into Fabric Notebooks — the code-first data engineering workhorse. They cover starter pools vs. custom environments, the new native Python mode, the notebook-to-production gap, and why your notebook that runs perfectly at 2pm crashes in the pipeline at 2am.

What we discuss

  • A real-world mistake from a pre-Fabric era
  • The one question that reframes the architectural debate
  • How we got here — predecessor products and evolution
  • Why the "obvious" answer is often wrong
  • A real Reddit/Microsoft Q&A question unpacked
  • The concrete recommended architecture
  • F-SKU realism — what this actually costs
  • When the rejected approach is actually right
  • Risks of the recommended path
  • What Microsoft is shipping that changes the calculus
  • The architectural principle to take home

Key takeaways

  • Completely fair. And I'll go further — I've seen teams spin up Spark to process ten megabytes of CSV. That's like renting a crane to hang a picture frame. If your transformation is row-level, SQL-expressible, and under a gig? A warehouse...
  • Nope. It's one or the other. And your team will absolutely discover this at the worst possible moment — usually during a demo. The play is: develop and explore on starter pools, switch to a custom Environment only for final testing and...
  • And teams do exactly that. Until they need great_expectations, or dbt-core, or some internal package. Starter pools give you the default library set — pandas, scikit-learn, plotly, the usual. But the moment you need anything custom, you...

Watch the episode

The Fabric Friday video on this topic: https://youtu.be/FUAQZEhQtFI

Resources

About the show

Built on ElevenLabs voice synthesis. Matthias — cloned voice. Fabia — designed AI co-host. See Matthias live on YouTube (Fabric Friday), at his meetups, and at conferences like FabCon.

Hosted by Matthias Falland — Microsoft Data Platform MVP and community architect behind the Fabric Periodic Table. New episodes every Friday.

Submit your case

Have an architecture decision you are wrestling with? DM Matthias on LinkedIn — find him as Matthias Falland. Three to five sentences about the decision, your team size, and your current stack. We anonymize before airing.

Built on ElevenLabs voice synthesis. Brand design based on fabricperiodictable.com.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(43)

A Label Is Not a Lock

A Label Is Not a Lock

A Label Is Not a Lock Episode 43 • 2026-10-30 Duration: 9:02 A sensitivity label says Highly Confidential in the header, but inside Fabric it never decides who opens the item. This episode traces wher...

30 Okt 9min

Five Thousand Files From a Blank Report

Five Thousand Files From a Blank Report

Five Thousand Files From a Blank Report Episode 42 • 2026-10-23 Duration: 10:17 Medallion is the recommended design approach for Fabric. It's also one building block out of five, and the one that send...

23 Okt 10min

Five Doors and One Credential

Five Doors and One Credential

Five Doors and One Credential Episode 41 • 2026-09-18 Duration: 8:45 Databricks and Fabric have five integration paths, not one. Each moves data. None moves permissions. We pull apart the one-credenti...

22 Okt 8min

Throttled by Yesterday's Refresh

Throttled by Yesterday's Refresh

Throttled by Yesterday's Refresh Episode 37 • 2026-10-16 Duration: 9:21 Fabric doesn't charge you when work happens — it spreads the cost forward into 2,880 thirty-second timepoints. That one sentence...

16 Okt 9min

Your Domain Isn't a Wall

Your Domain Isn't a Wall

Your Domain Isn't a Wall Episode 38 • 2026-10-09 Duration: 8:43 Fabric domains look like governance boundaries but the documentation says otherwise. We unpack what a domain actually gives you, the def...

9 Okt 8min

Where Do the Columns Come From?

Where Do the Columns Come From?

Where Do the Columns Come From? Episode 40 • 2026-09-25 Duration: 9:19 Cosmos DB has no schema. Delta tables need one. When mirroring bridges the two, the replicator guesses — and the guess only ever ...

6 Okt 9min

The Permission Split Inside Read-Only

The Permission Split Inside Read-Only

The Permission Split Inside Read-Only Episode 36 • 2026-10-02 Duration: 8:03 A workspace carries four boundaries — security, cost, region, lifecycle — and you configured one of them. This episode pull...

4 Sep 8min

The Snapshot Locked in a Room

The Snapshot Locked in a Room

The Snapshot Locked in a Room Episode 35 • 2026-08-28 Duration: 8:42 Graph in Fabric materializes a second copy of your data for traversal. That copy explains the staleness, the rebuild cycle, and the...

28 Aug 8min

Populært innen Business og økonomi

stopp-verden
dine-penger-pengeradet
rss-penger-polser-og-politikk
e24-podden
rss-borsmorgen-okonominyhetene
rss-neste-generasjon-med-emilie-stordalen
utbytte
livet-pa-veien-med-jan-erik-larssen
rss-skravla-gar
rss-pa-konto
pengepodden-2
tid-er-penger-en-podcast-med-peter-warren
lederpodden
finansredaksjonen
stormkast-med-valebrokk-stordalen
okonomiamatorene
pengesnakk
morgenkaffen-med-finansavisen
liberal-halvtime
rss-orjasater