DataTrail

Blog

Data lineage and data observability, explained

Guides and practical playbooks for mapping data flow table-to-table, tracing columns to their source, monitoring freshness, catching schema changes, and seeing downstream impact before a change breaks a dashboard.

Comparisons 8 min read

Alation vs Informatica Pricing and Data Lineage Compared for Catalog Buyers

Alation vs Informatica on real list prices: Alation $60,000 a year on AWS with lineage at $12,091 per connector, Informatica $131,760 for 120 IPU a month.

Read article
Comparisons 8 min read

Snowflake Data Governance Tools Compared on Price for Atlan, Collibra, Alation and Immuta

Snowflake data governance tools on published prices: Horizon is included on Enterprise, Alation lists $60,000, Immuta $96,000, Collibra $170,000. Which to buy.

Read article
Comparisons 8 min read

Ataccama vs Collibra Compared on Pricing, Data Quality and Lineage

Ataccama vs Collibra on real pricing: Collibra lists $170,000 on AWS and data quality from £122,919 on its filed rate card; Ataccama publishes only its meter.

Read article
Comparisons 8 min read

Select Star vs Atlan Pricing, Lineage and Which to Buy After Snowflake

Select Star listed $300 and $900 a month and Vendr puts the median near $36,000 a year; Atlan's filed rate card starts near $148,700 before seats. Worked costs, lineage, and the Snowflake question.

Read article
Comparisons 8 min read

Soda vs Great Expectations Pricing and Licenses After GX Cloud Closed

GX Core is free and Apache-2.0 under Fivetran, GX Cloud closed on 1 June 2026, and Soda Team is $750 a month on an Elastic-licensed engine. Which to buy.

Read article
Comparisons 8 min read

Metaplane vs Sifflet Pricing, Which Is Cheaper for a Data Team

Metaplane is free for 10 tables and Datadog lists it at $16 per table a month; Sifflet's only public price is $48,000 on AWS. Where they cross, and which to buy.

Read article
Pricing 8 min read

dbt Cloud Pricing and dbt Cloud Enterprise Pricing per Seat in 2026

dbt Cloud pricing from primary sources: Starter $100 per seat for up to five, Enterprise $48,000 a year for 10 licenses on AWS, plus model, metric and dbt State meters.

Read article
Comparisons 8 min read

DataHub vs Collibra Pricing and Data Lineage for Teams Choosing a Catalog

DataHub vs Collibra on real list prices: DataHub Cloud $75,000 a year for 20 users, Collibra $170,000 plus lineage add-ons per source. Worked cost and which to buy.

Read article
Comparisons 8 min read

Collibra vs Informatica Pricing and Data Governance for Enterprise Buyers

Collibra vs Informatica on real list prices: Collibra $170,000 a year on AWS, Informatica $131,760 for 120 IPU a month. Lineage, ownership and which to buy.

Read article
Comparisons 8 min read

DataHub vs Atlan Pricing for Teams Choosing a Data Catalog

DataHub vs Atlan on real prices: DataHub Cloud lists $75,000 a year for 20 active users, Atlan filed £110,000 before seats. Worked cost for a 15-person team.

Read article
Comparisons 8 min read

Acceldata vs Anomalo on Pricing, Scope and Which to Buy

Acceldata vs Anomalo on real prices: $5,000 per Data Reliability unit and $100,000 per Spend Intelligence account against an Anomalo listing at $1 per undefined unit and $58,000 to $164,688 a year reported.

Read article
Comparisons 8 min read

Anomalo vs Monte Carlo on Pricing, Quality vs Observability and Which to Buy

Anomalo vs Monte Carlo on published prices: $0.18 to $0.28 per Monte Carlo credit against an Anomalo listing priced at $1.00. Worked costs by table count, and which one to buy.

Read article
Comparisons 8 min read

Datafold vs Monte Carlo on Pricing, CI Testing vs Observability and Which to Buy

Datafold vs Monte Carlo on published prices: $3,000 per developer a year against $0.18 to $0.28 per credit. Worked costs by team size, and which one a dbt team should buy.

Read article
Comparisons 8 min read

Secoda vs Atlan Pricing and Lineage After the Atlassian Acquisition

Secoda vs Atlan on published pricing (Atlan's filed £110,000 to £300,000 rate card, Secoda's blank), column-level lineage, and what the Atlassian deal changes.

Read article
Comparisons 9 min read

OpenMetadata vs DataHub Pricing, Licensing and Lineage Compared for Managed and Self-Hosted Teams

OpenMetadata vs DataHub: Collate and DataHub Cloud both list at $75,000 a year on AWS Marketplace. What each covers, the license split, and which to pick.

Read article
Comparisons 8 min read

Metaplane vs Monte Carlo for Data Observability With Pricing per Monitored Table

Metaplane vs Monte Carlo on published prices: $19,200 a year for 100 tables at Datadog's $16 rate, $11,498 to $17,885 at Monte Carlo. Where the costs split and which fits.

Read article
Pricing 9 min read

Immuta Pricing and What Immuta Costs per Connector, User and Year

Immuta costs $98,740.55 a year per data platform connector and $493.70 per Access User on the US GSA schedule. The full rate card, the UK seat classes, and a worked example.

Read article
Pricing 9 min read

Bigeye Pricing, $45,000 for 100 Tables, $75,000 for 300 and the Cost per Table

Bigeye lists two packages on AWS and Microsoft Marketplace: $45,000 a year for 100 monitored tables, $75,000 for 300, so $450 falling to $250 per table. Verified.

Read article
Comparisons 9 min read

Bigeye vs Monte Carlo Pricing and Cost per Monitored Table Compared

Bigeye lists $45,000 for 100 monitored tables and $75,000 for 300, so cost per table is computable. Monte Carlo lists $50,000 for an undefined Credit.

Read article
Comparisons 8 min read

Acceldata vs Monte Carlo Pricing and Data Observability Compared

Monte Carlo lists $50,000 a year for a Credit it never defines. Acceldata lists $5,000 and $100,000 and does state the meter. Both read live on 6 September 2026.

Read article
Comparisons 8 min read

Cyera vs Sentra Pricing and What Cyera and Sentra Actually Cost per Terabyte

Cyera lists $50,000 to $250,000 against stated 25TB, 100TB and 250TB ceilings. Sentra lists $50,000 to $500,000 in gigabytes with no quantity stated. Both read live.

Read article
Comparisons 11 min read

Varonis Pricing and Varonis Cost per Year From the Full Per-Connector Rate Card

Varonis lists 17 per-connector unit prices on AWS Marketplace ($310 Slack, $400 M365, $30,000 Snowflake) and 98 user-banded SKUs on the US GSA schedule, $12.55 to $1,546.63 per unit.

Read article
Comparisons 8 min read

BigID vs Collibra vs Microsoft Purview Published Pricing Compared

BigID lists $175,000 and Collibra $170,000 for 12 months on AWS Marketplace. Purview meters $0.0165 per asset per day. Real prices, read from primary sources.

Read article
Comparisons 10 min read

Informatica Pricing with IPU Cost, AWS List Prices and What IDMC Really Costs

Informatica publishes no prices, but its AWS Marketplace listing puts 120 IPU per month at $131,760 a year: exactly $91.50 per IPU, with no multi-year discount.

Read article
Comparisons 8 min read

Atlan Pricing vs Alation Pricing and Cost Compared on Data Lineage and Which Catalog to Buy

Atlan pricing vs Alation pricing on real list figures: Alation costs $60,000 a year on AWS, Atlan files £110,000 (about $148,700) before seats. Lineage and which to buy.

Read article
Comparisons 8 min read

Alation vs Collibra Pricing and Which Enterprise Data Catalog Costs Less

Collibra lists at $170,000 a year and Alation at $60,000 on AWS Marketplace, but their US federal price lists put the platforms at $166,346.53 and $251,889.17. What the gap really means.

Read article
Comparisons 9 min read

Marquez Data Lineage Cost to Self-Host, Its Maintenance Status and Managed Alternatives

Marquez last shipped an artifact in March 2025 while OpenLineage published 27 releases. What self-hosting the reference backend really costs.

Read article
Comparisons 8 min read

watsonx.data Integration Pricing with IBM Resource Unit Cost, DataStage Plans and Databand

IBM publishes no price on its pricing page, but its public cloud catalog API returns $26.50 per Resource Unit, with a recommended 200 unit monthly minimum.

Read article
Playbooks 8 min read

Data Quality Dimensions and Metrics for Measuring Quality with a Scorecard

The six dimensions with the SQL that computes each one, why accuracy is the one nobody measures, and a weighted scorecard that does not sit at 0.97 forever.

Read article
Comparisons 9 min read

Open Source Data Catalog Tools Still Maintained, Their Lineage and True Cost

Which open source data catalogs are actually maintained in 2026, checked against the GitHub API: Amundsen was archived in September 2026 after zero commits to main in a year.

Read article
Playbooks 10 min read

Data Lineage Documentation Best Practices and BCBS 239 Requirements

What lineage documentation must contain, what BCBS 239 actually requires (its 2013 text never says lineage), plus a row-per-hop template and a worked example.

Read article
Guides 9 min read

OpenLineage and How the Open Standard Tracks Spark, dbt and Airflow Lineage

What OpenLineage is, how the Dataset, Job, Run and Facet model works, whether it does column-level lineage, which tools emit events, and its blind spot.

Read article
Guides 8 min read

BigQuery Lineage Not Showing and How to View It in the Console

How to open the Lineage tab on a BigQuery table, find the query that built it, and fix an empty graph. The 30-day retention limit, the roles, and the exact errors.

Read article
Guides 9 min read

Snowflake Column-Level Lineage and How to Check a Column with GET_LINEAGE

Three ways to check column-level lineage in Snowflake: the GET_LINEAGE function, the Snowsight Lineage tab, and ACCESS_HISTORY in bulk. With SQL and the real limits.

Read article
Guides 9 min read

Data Contracts in dbt and What a Model Contract Actually Enforces

dbt model contracts fail a build when a model changes shape. But on Snowflake, BigQuery and Redshift only not_null is really enforced. The full matrix.

Read article
Guides 8 min read

Data Quality vs Data Integrity vs Data Verification

Data quality asks if data is fit for use. Data integrity asks if it survived intact. The precise difference, where each breaks, and what it changes about buying.

Read article
Guides 9 min read

Data Governance Framework Components, Policy and Examples

A data governance framework defines who decides what about your data. The DGI and DAMA models compared, the components that matter, and how to build one.

Read article
Pricing 9 min read

Microsoft Purview Pricing at $0.0165 per Governed Asset a Day and $15 to $240 per Processing Unit

Microsoft Purview pricing from the live Azure price list: $0.0165 per governed asset a day, $15 to $240 per processing unit, plus every security and compliance meter.

Read article
Platforms 8 min read

Snowflake Data Catalog and What Horizon Covers and Misses

Yes, Snowflake has a data catalog. Horizon Catalog covers discovery, tagging, classification and column-level lineage. What it includes, and where it stops.

Read article
Guides 8 min read

Data Observability vs Monitoring and When You Need Each

Data monitoring checks rules you wrote; data observability learns each table's normal behavior and flags what you never thought to check. The real difference.

Read article
Guides 11 min read

Great Expectations vs dbt Tests and Which Data Quality Approach Fits

dbt tests are SQL assertions in your project; Great Expectations validates data anywhere, including before it lands. When to use each, and how to split them.

Read article
Guides 9 min read

Looker Data Lineage in LookML and Knowledge Catalog and Where It Stops

How data lineage works in Looker, why the PDT graph and Knowledge Catalog integration are not column-level, and how to trace a LookML measure to its column.

Read article
Guides 15 min read

Collibra Pricing Model and How Licensing Works Package by Package and Seat by Seat

How Collibra's five meters interact: platform packages, Creator and Contributor seats, per-system connectors, modules and support, with what each package bundles and what to negotiate.

Read article
Guides 8 min read

Snowflake Data Quality Checks with DMFs and dbt Tests and What Each Misses

How to run data quality checks in Snowflake with data metric functions, the documented DMF limits, where dbt tests stop, and why lineage makes alerts useful.

Read article
Guides 9 min read

Automated Data Quality Monitoring and Where Lineage Fits In

How automated data quality monitoring flags anomalies without per-table rules, the three layers that make it work, and why it needs lineage to be actionable.

Read article
Guides 9 min read

Power BI Lineage View for Impact Analysis and Column-Level Lineage

The Power BI lineage view maps dataflows and datasets but stops at the semantic model. What it misses, and how to trace a column downstream into reports.

Read article
Guides 9 min read

Tableau Data Lineage in Tableau Catalog and Where Field-Level Lineage Stops

How Tableau Catalog builds column-level data lineage, why it needs the Data Management add-on, where custom SQL breaks it, and how to trace the path upstream.

Read article
Guides 11 min read

Data Lineage for BI Tools with Power BI, Tableau and Looker Compared

Built-in data lineage in Power BI, Tableau and Looker each stops at its own boundary. Why warehouse-native column lineage gives you one graph instead of three.

Read article
Guides 10 min read

How to Handle Schema Drift by Detecting, Ranking and Fixing It Before Reports Break

A playbook for handling schema drift: detect structural changes from warehouse metadata, and rank drift by downstream impact so alerts do not get muted.

Read article
Guides 11 min read

Airflow Data Lineage with OpenLineage and Marquez and What They Miss

How to get data lineage out of Apache Airflow with the OpenLineage provider and Marquez, what column-level lineage you get, and the coverage gaps that remain.

Read article
Guides 10 min read

How to Visualize dbt Lineage Beyond the DAG with Column-Level Graphs

How to visualize dbt lineage, from the built-in docs DAG to column-level graphs, why the dbt DAG stops at your project boundary, and how to see the full path.

Read article
Guides 11 min read

Schema Change Impact Analysis Shows What Breaks Before You Deploy

See the downstream impact of a schema change before it ships: every model, dashboard and sync that reads the column, by name, then a safe deploy plan.

Read article
Fundamentals 10 min read

Data Lineage vs Data Catalog and Which One You Need

A data catalog tells you what data exists; data lineage tells you how it connects and what breaks. How they differ, and which one your team needs first.

Read article
Guides 10 min read

Redshift Data Lineage Built From Query History

How to trace column-level lineage in Amazon Redshift from the system tables, why the seven-day log retention is the catch, and how to fill that gap.

Read article
Guides 11 min read

Schema Drift Detection That Catches a Breaking Column Change Before It Ships

How to detect schema drift with metadata your warehouse already exposes, why naive snapshot-and-diff gets muted in a week, and how lineage fixes the alerts.

Read article
Guides 10 min read

dbt Dependency Graph and How to See It, Use It and Know Where It Stops

How dbt builds its DAG from ref and source calls, the three ways to read it, the graph operators worth knowing, and what lives outside the graph entirely.

Read article
Guides 11 min read

Root Cause Analysis for Data Pipelines in Four Steps

A repeatable method for tracing a wrong number back to its cause: pin the symptom, walk the lineage, check three failure classes, confirm with timestamps.

Read article
Fundamentals 10 min read

What Is Data Lineage? A Plain-English Guide for Data Teams

What data lineage is, why it matters, and how table and column-level lineage let you trace any number to its source and see what breaks before a change ships.

Read article
Fundamentals 10 min read

What Is Data Observability? The Five Pillars Explained

Data observability is how you know your data is fresh, complete, and correct. Learn the five pillars, how it differs from monitoring, and where lineage fits.

Read article
Guides 9 min read

Data Lineage Example Tracing Revenue From Source to Dashboard

A concrete data lineage example: follow orders.revenue from a raw Stripe table through staging and models to the dashboards that depend on it, column by column.

Read article
Reliability 8 min read

What Is Data Downtime, and What Does It Cost You?

Data downtime is any period when your data is wrong, missing, or stale. Learn how it happens, how to measure it, and how to catch it before a person does.

Read article
Playbooks 11 min read

How to Build Data Lineage Manually, with dbt or Automatically

How to build data lineage three ways: by hand, from dbt, and automatically from query logs. The tradeoffs, the staleness problem, and what column-level adds.

Read article
Fundamentals 9 min read

Data Observability vs Data Quality and How They Differ

Data observability and data quality are related but not the same. Learn how monitoring, testing, and lineage fit together, and where each one catches problems.

Read article
Buyer Guides 11 min read

Best Data Observability Tools in 2026 and How to Choose

The best data observability tools compared on lineage depth, freshness and schema monitoring, impact analysis, pricing model, and time to value. How to choose.

Read article
Guides 9 min read

BigQuery Data Lineage Across Columns and Datasets

How BigQuery data lineage works, what INFORMATION_SCHEMA and audit logs give you, where they stop, and how to get automatic column-level lineage that stays current.

Read article
Fundamentals 9 min read

Column-Level Lineage Explained and Why Table-Level Is Not Enough

Column-level lineage traces a single field through every transformation. Why table-level lineage misses breaks, and how column lineage answers what feeds a number.

Read article
Guides 10 min read

Snowflake Data Lineage Guide to Tracing Data Flow

How Snowflake data lineage works with ACCESS_HISTORY and QUERY_HISTORY, what you can build yourself, and how to get automatic column-level lineage.

Read article
Guides 9 min read

Downstream Impact Analysis of Data Changes and What a Column Change Will Break

How to find every downstream dependency of a table before you change it: query history, column-level parsing, and the chain out to the dashboards in use.

Read article
Buying 8 min read

Unity Catalog vs Purview on Pricing, Lineage and Which to Buy for Databricks

Unity Catalog vs Purview on price: Unity Catalog comes with the Databricks Premium uplift ($0.15 to $0.30 per DBU-hour), Purview bills $0.0165 per asset per day. Which to buy.

Read article
Platforms 9 min read

Unity Catalog Lineage and What Databricks Data Lineage Captures and Misses

Unity Catalog captures column-level lineage on Databricks. What it covers, the documented gaps around renames, path reads and the one-year window, and the fix.

Read article
Buying 8 min read

Data Observability Pricing and What Actually Drives the Quote

Data observability pricing from real rate cards: Monte Carlo $50,000, Sifflet $48,000, Bigeye $45,000 per 100 tables, Datafold $15,000. What moves your quote.

Read article

Put it into practice

Connect your warehouse read-only and see your lineage map in 15 minutes. Transparent pricing, no card to start.