Data Engineering  /  Data Modeling

๐Ÿงฑ Data Modeling 20 guides ยท updated 2026

From ER diagrams to data mesh โ€” relational, dimensional, NoSQL, and governance-driven modeling for building data platforms people can trust.

Master Data Management (MDM): One Customer, One Truth Across Every System

Hereโ€™s a test that embarrasses almost every company: pick one real customer and count how many versions of them exist across your systems. The CRM has โ€œAsha Patelโ€ with her work email. Billing has โ€œA. Patelโ€ with a home address from 2021. Support has two records because she wrote in from a personal address once. The warehouse has all four, joined to different orders. Now answer a simple question โ€” what is this customer worth to us? โ€” and watch four systems give four answers.

Master Data Management is the discipline (and product category) that fixes this: creating and maintaining a single, authoritative version of the businessโ€™s core entities โ€” customers, products, suppliers, locations, employees โ€” and making every system agree on it. This post explains what master data is, how the machinery works (matching, survivorship, golden records), the implementation styles, and why MDM programs fail far more often for organizational reasons than technical ones.

What Counts as Master Data

Not all data needs mastering. The classic segmentation:

The tell for whether an entity needs mastering: do multiple systems each create their own records for the same real-world thing? If yes โ€” and for customers and products the answer is almost always yes โ€” duplication and drift are structural, not accidental, and no amount of โ€œbe carefulโ€ fixes them.

The Machinery: How a Golden Record Gets Made

MDMโ€™s technical core is a pipeline that turns many conflicting records into one trusted one:

1. Ingest and standardize. Collect candidate records from every source; normalize formats first (case, phone formats, address standardization against postal references). Half of โ€œdifferentโ€ records differ only in formatting.

2. Match (entity resolution). Decide which records refer to the same real-world entity. Techniques, in ascending sophistication:

The thresholds encode a real business trade-off: false merges are usually worse than missed matches (un-merging two genuinely different customers after months of blended history is miserable), so mature programs set the auto-merge bar high and route the gray zone to human data stewards.

3. Survivorship. Once records are matched, conflicting values must be resolved: three phone numbers, two addresses. Survivorship rules decide per attribute โ€” not per record โ€” which value wins:

The result is the golden record: the assembled best-known-truth for the entity, carrying lineage back to every contributing source record โ€” you never discard the sources.

4. Distribute. The golden record (or at minimum, cross-reference keys linking each systemโ€™s local ID to the master ID) flows back out โ€” via APIs, events, or sync โ€” so the CRM, billing, and warehouse converge instead of drifting further.

CRM record

Match & merge

(entity resolution)

Billing record

Support record

๐Ÿ† Golden record

+ cross-reference keys

+ lineage to sources

โ†’ back to systems

โ†’ warehouse / analytics

Data steward

reviews gray-zone matches

Implementation Styles: How Intrusive Do You Want to Be?

MDM programs differ mainly in where the golden record lives relative to operational systems. Four canonical styles, in ascending ambition:

Registry. The hub stores only match results and cross-reference keys โ€” a directory saying โ€œCRM #123 = Billing #987 = master #M-55.โ€ Source data stays put. Cheap, fast to stand up, and enough for analytics (โ€œjoin everything on the master keyโ€). No cleanup of the sources themselves.

Consolidation. The hub additionally assembles golden records โ€” but only for downstream consumption (the warehouse, compliance reporting). Operational systems keep their local versions. This is where most successful programs start, because it delivers a trustworthy โ€œcustomer 360โ€ without touching operational workflows.

Coexistence. Golden records sync back into source systems; authoring continues in the sources. Consistency improves everywhere, at the cost of real synchronization engineering and conflict handling.

Centralized (transaction hub). Master data is authored in the MDM hub; other systems subscribe. Maximum consistency, maximum intrusiveness โ€” every workflow that creates a customer must change. Rare, and rarely the right first move.

The pragmatic path most experienced practitioners recommend: registry or consolidation first, prove value in analytics, then earn the right to push upstream.

Why MDM Programs Fail (Itโ€™s Rarely the Software)

MDM has a deserved reputation as a graveyard of multi-year enterprise programs. The recurring causes are worth naming because theyโ€™re avoidable:

Where MDM Sits in the Modern Stack

Two contemporary notes. First, MDM and data mesh have a real tension โ€” mesh decentralizes ownership, but shared entities like โ€œcustomerโ€ inherently cross domains. The emerging resolution: treat master data itself as a data product with a clear owning team, consumed by all domains โ€” federation for most data, deliberate centralization for shared identity. Second, warehouse-native approaches (entity resolution run in Snowflake/BigQuery with dbt and specialized matching tools) have made consolidation-style MDM dramatically cheaper than the classic hub appliances โ€” lowering the entry price for the style you should start with anyway.

A Realistic Starting Sequence

  1. Pick one entity (customer) and two or three highest-pain sources.
  2. Get written agreement on the definition and the survivorship priorities per attribute.
  3. Stand up matching with conservative auto-merge thresholds; route the rest to a named steward with real hours.
  4. Publish golden records and cross-reference keys to the warehouse; measure something visible (duplicate rate, marketing bounce rate, support handle time).
  5. Only then consider syncing back to operational systems.

The quiet truth about MDM: itโ€™s identity management for your businessโ€™s nouns, and identity โ€” as the fundamentals post in this series argued โ€” is the modeling decision everything else leans on. Companies that know who their customers are, singularly and confidently, make every downstream investment (analytics, personalization, compliance, AI) on solid ground. Companies that donโ€™t are building on four versions of Asha Patel.