Five Thousand Files From a Blank Report

Five Thousand Files From a Blank Report

Episode 42 • 2026-10-23 Duration: 10:17

Medallion is the recommended design approach for Fabric. It's also one building block out of five, and the one that sends you a maintenance invoice nobody put on the architecture diagram. What the file-count guardrail means for Direct Lake on OneLake, why schema-enabled lakehouses can't use the automated maintenance activity, and when the whole pattern is overkill.

What we discuss

• How it actually works underneath the abstraction
• The pattern we keep seeing in the field
• Where the obvious answer breaks
• A real Reddit/Microsoft Q&A question unpacked
• F-SKU realism — what this actually costs
• When the rejected approach is actually right
• The concrete recommended architecture
• The architectural principle to take home

Key takeaways

• Somewhere right now, there's a table sitting at four thousand files on an F64.
• The price of that answer is maintenance. A schedule, a monitor, and someone who knows where TABLETRAITS lives.
• Architecture is not religion. Medallion answers one question — what is each stage trusted for — and it leaves the other four to the other four bricks.

From the video

• Architecture film: Five building blocks
• Architecture film: Each layer is a contract
• Demo 1: Bronze That Copies Nothing
• Demo 2: Silver as a Contract
• Architecture film: When recipe is wrong

Resources

• Understand medallion architecture for Fabric with OneLake
• OneLake patterns and foundational capabilities
• Common dbt job patterns
• Modern data warehouse medallion architecture in Microsoft Fabric
• What are materialized lake views?
• Spark SQL reference
• Optimal refresh
• Cross-workload table maintenance and optimization
• What's new
• Lakehouse Maintenance activity
• Apache Spark billing and utilization
• extended capabilities
• CDF page
• Data quality in materialized lake views
• Manage materialized lake views lineage

About the show

AI-generated voices. Matthias — cloned voice. Fabia — designed AI co-host. See Matthias live on YouTube (Fabric Friday), at his meetups, and at conferences like FabCon.

Hosted by Matthias Falland — Microsoft Data Platform MVP and community architect behind the Fabric Periodic Table. New episodes every Friday.

Submit your case

Have an architecture decision you are wrestling with? DM Matthias on LinkedIn — find him as Matthias Falland. Three to five sentences about the decision, your team size, and your current stack. We anonymize before airing.

This podcast was generated by AI. Both voices are synthetic: Matthias is a cloned voice, Fabia is a designed AI co-host.

Brand design based on fabricperiodictable.com.