Skip to content
Upstream

GUIDE, read 10 Nov 2026

You can test a lineage tool in a week by tracing five real incidents through it and recording where each trace stops

The matrixAll guides

Test with your incidents, not the demo

A vendor demo uses a dataset the vendor chose. A trial with your own incidents tells you where the graph stops on your stack. Start by listing five times in the last year when a number was wrong and someone had to trace it. Write for each the dashboard field, the warehouse column where the fault began, and the path between them.

These five traces are your answer key. A tool that reproduces four of them, with the right columns, is better for you than a tool with a longer feature list. Keep the key fixed for every candidate, so the comparison stays fair. Choose incidents of different kinds: one from a join, one from a metric definition, one from a late source, one from a renamed column and one that crossed into a BI tool. A key made of five similar faults tests only one skill.

The week, day by day

The plan below assumes two or three candidates and one person doing the work. It trades breadth for repeatability.

DayTaskPass condition
1Write the five incident traces; choose a model with a join, a window function and a CASE columnAnswer key is written and dated
2Connect warehouse, transformation tool and one BI tool to each candidateConnected with read-only access; note the time it took
3Compare column lineage on the chosen models against your answer keyEvery key column edge appears, or the gap is documented
4Trace one BI field back to a warehouse column, and one warehouse column forward to a BI fieldBoth directions reach the real field, not only the dashboard
5Change a column in a test branch; see how soon the graph reflects itChange visible within the vendor's stated window
6Query lineage through the agent interface using a restricted roleAnswer matches the UI and does not exceed the role
7Score each candidate against the key and the weights belowWritten result with gaps listed

Know each tool's documented limits before you start

Vendors publish the cases they cannot handle. Use them to design the tests that matter. The list below is drawn from the vendors' own pages as read on 10 Nov 2026.

ToolDocumented limit to probeWhat to test
AtlanColumn lineage excludes JOIN, FILTER and GROUP BY; BI lineage works only for supported warehouse-to-BI pairsA join-key column; your exact BI tool
CollibraNo column lineage for SQL-created tables unless SQL is supplied through shared storage; Power BI DirectQuery and live connections excludedA table created by a CTAS; your Power BI connection mode
Monte CarloWildcard tables, nested fields and some JOIN+USING cases not covered; Tableau is the BI tool documentedA SELECT * model; a nested field
SnowflakeExcludes tables used only for joins or filters; unavailable for shared databasesA lookup table; a shared database
dbtColumn lineage reflects select statements onlyA filter column
Coalesce CatalogGraph uses the last 30 days of SQL; Sigma and Omni are asset-level onlyA quarterly job
SecodaColumn-to-BI-field lineage documented for Looker and Tableau onlyA Power BI or Metabase field
SYNQFlags lineage as uncertain when parsing failsWhether the flag appears on your hard SQL
DatabricksLineage requires tables registered in Unity Catalog and queries through Spark DataFrame or Databricks SQLA table outside Unity Catalog
OpenLineageBI-field or metric lineage: none found on 10 Nov 2026Whether a consumer adds it

What to look for on each day

On day 3, do not stop at whether the edges exist. Check what each edge says. Some tools show the transformation formula, some show only that two columns are linked. For the join-key column, record whether the tool shows an edge at all, a flag, or nothing. SYNQ says it flags lineage as uncertain when parsing or dependency extraction fails. A flag is better than silence.

On day 4, be strict. A tool that shows the dashboard but not the field fails the test, even if the dashboard is the right one. The matrix shows four tools, DataHub, Euno, Foundational and Select Star, with a yes for BI field. Eleven are partial and OpenLineage is none found. Your stack decides whether a partial is enough: Secoda's Looker and Tableau coverage is complete if you use only those two.

On day 5, use the vendor's own number. Euno's FAQ says sources sync daily by default, with manual syncs possible, so a change can wait up to a day unless you trigger a sync. Compare each tool's actual lag with what you need. A graph that lags a day is fine for audits and poor for pull-request checks.

Weights that match common priorities

Upstream scores tools on eight criteria. Depth of lineage carries 25 points, lineage that carries meaning 20, being served to agents 20, coverage of the stack 15, staying current without work 10, safe to deploy 5 and price transparency 5, with official and maintained at 0. Use these or write your own, but write them before you see the results.

Upstream's published totals are Euno 67.0, DataHub 62.5, Secoda 61.5, Atlan 58.5, Foundational 58.0, Coalesce Catalog 57.0, Collibra 56.5, Alation 55.0, dbt Labs 54.0, Snowflake 51.5, SYNQ 50.5, Monte Carlo 50.0, Databricks 47.5, Select Star 46.5, Manta 40.5, and OpenLineage and Marquez 36.0. Euno is cloud SaaS only and publishes no dollar prices; a team that needs lineage inside its own network, or a full catalog around it, will pair it with another tool.

These are desk scores from public documentation. Your week of testing is what tells you whether they hold for your stack. If your result disagrees with a total, your result is the better evidence for your stack.

Questions to put to the vendor on day 7

Bring the gaps from your answer key. Ask whether each is on the roadmap, and ask for the date. Ask how the tool reaches your BI product and in which connection mode. Ask what a read-only deployment looks like, and where the metadata is stored. Ask for the price in writing: several vendors in the evidence publish tiers without dollar amounts, and a number on paper is easier to compare than a range described in a call.

Finally, ask what happens when lineage is wrong. DataHub warns that manually edited lineage may conflict with ingested lineage and be overwritten, which is the kind of behavior worth knowing before you add a hand-made edge. A good answer describes a correction path, not a promise that errors do not happen.

Reading the result

Keep the setup honest. Give each candidate the same permissions, the same sources and the same number of days, and run the same traces in the same order. Note setup time as a result in its own right: a tool that needs a week of connector work before it shows the first edge has a cost that no feature list reveals. Record who did the work too, since a platform team may handle a connector that an analytics engineer cannot.

Decide in advance what counts as a pass for each trace: the right columns, the right direction, the right number of hops, and the right BI field. Write it down before the first run, and score each trace as pass, partial or fail. A partial that you can explain is useful. A pass you cannot reproduce on a second run is not.

Count how many of the five incident traces each tool reproduced end to end. Count the places where it showed a flag rather than silence. Note the lag on the day 5 change, and the role on the day 6 query. A tool that reproduces four of five, flags the fifth, syncs within a day and respects the role is ready for a pilot on a real pipeline. The compare page and the method page set out the criteria in full.

Sources

  1. Atlan: docs.atlan.com/product/capabilities/lineage/best-practices/capture-and-troublesh, read 10 Nov 2026
  2. Collibra: productresources.collibra.com/docs/collibra/latest/Content/CollibraDataLineage/r, read 10 Nov 2026
  3. Monte Carlo: docs.getmontecarlo.com/docs/field-lineage, read 10 Nov 2026
  4. Snowflake: docs.snowflake.com/en/user-guide/ui-snowsight-lineage.md, read 10 Nov 2026
  5. dbt: docs.getdbt.com/docs/explore/column-level-lineage, read 10 Nov 2026
  6. Coalesce Catalog: docs.coalesce.io/docs/catalog/navigate/lineage.md, read 10 Nov 2026
  7. Secoda: docs.secoda.co/features/data-lineage.md, read 10 Nov 2026
  8. SYNQ: docs.synq.io/lineage/column-level-lineage.md, read 10 Nov 2026
  9. Databricks: docs.databricks.com/aws/en/data-governance/unity-catalog/data-lineage, read 10 Nov 2026
  10. OpenLineage: openlineage.io/docs, read 10 Nov 2026
  11. Euno: docs.euno.ai/support-resources/faq.md, read 10 Nov 2026
  12. DataHub: docs.datahub.com/docs/features/feature-guides/lineage, read 10 Nov 2026

Last reviewed 10 Nov 2026.