Agile Data N’ Info4 Sep 2025

Data Match, AgileData Engineering Pattern #7 - Episode #75

Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the Data Match.

The Data Match pattern provides an automated, granular comparison capability to efficiently identify and report discrepancies between two datasets, moving from row counts to specific data values.

This 'data diff' solution transforms hours of manual data reconciliation into minutes by optimising comparisons for cloud analytics databases like BigQuery, serving as a support feature for on-demand exception handling rather than a continuous trust rule.

An AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and embed quality by default.

If you want a copy of the pattern template head over to:

https://agiledata.substack.com/i/172820886/pattern-name

Discover more AgileData Engineering Patterns over at https://agiledata.substack.com/s/agiledata-engineering-patterns

If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.

Buy the Green Book now!

Simply Magical Data Ways of Working

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(89)

Listen now | Recording of AURA - Tim Frazer & Shane Gibson on 5th August 2026

Raw and unedited :: https://agiledata.substack.com/p/watch-now-recording-of-aura-tim-frazer-0d1 <-OO-> Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io...

7 Aug 1h 2min

Watch now | Recording of AURA - Tim Frazer & Shane Gibson on 5th August 2026

Raw and unedited https://agiledata.info/p/watch-now-recording-of-aura-tim-frazer-0d1?utm_source=youtube

6 Aug 1h 2min

Listen now | Recording of AURA - Juha Korpela & Shane Gibson on 31st July 2026

Raw and unedited :: https://agiledata.info/p/watch-now-recording-of-aura-juha <-OO-> Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on th...

3 Aug 1h 1min

Watch now | Recording of AURA - Juha Korpela & Shane Gibson on 31st July 2026

Raw and unedited https://agiledata.info/p/watch-now-recording-of-aura-juha?utm_source=youtube

31 Jul 1h 1min

Listen now | Recording of AURA - Anna Bergevin & Shane Gibson on 13th July 2026

Raw and unedited :: https://agiledata.info/p/watch-now-recording-of-aura-anna <-OO-> Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on th...

13 Jul 1h

Listen now | Recording of AURA - Chris Gambill & Shane Gibson on 10th July 2026

Raw and unedited :: https://agiledata.info/p/watch-now-recording-of-aura-chris <-OO-> Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on ...

10 Jul 1h 1min

Listen now | Recording of AURA - Tim Frazer & Shane Gibson on 1st July 2026

Raw and unedited :: https://agiledata.info/p/watch-now-recording-of-aura-tim-frazer <-OO-> Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read mor...

1 Jul 1h 1min

The patterns of Focal Data Modeling and Identity Resolution with Patrik Lager

In this episode of the Agile Data Podcast, where host Shane Gibson sits down with Patrik Lager, a data integration expert with 25 years of experience and a lead developer of the Focal framework. In th...

8 Mai 1h 4min