NEWS, 13 OCT 2026, read 10 Nov 2026
OpenLineage 1.54.0 adds Spark column lineage for CTAS and RTAS
OpenLineage release 1.54.0 is dated 13 Oct 2026. Its lineage-depth change is in the Spark integration: it now traverses childless CTAS and RTAS query plans and nested operators to capture complete column dependencies, on Spark 3.5 and Databricks runtimes.
A second change sits in the SQL parser. The release upgrades sqlparser to 0.63.0 and keeps dependencies found in aggregate WHERE predicates, ESCAPE expressions, IS JSON operands and Redshift expression unpivoting. It rejects SQL pipe queries explicitly rather than guessing.
The rest is connection plumbing: HTTP proxy support and Unix domain socket URLs in the Java client, custom CA certificates and mutual TLS in the Python client, and OAuth 2.0 client credentials in the Java and Python clients. The dbt integration also recognizes presto and watsonx_presto profiles.
More lineage news
Sources
- github.com/OpenLineage/OpenLineage/releases/tag/1.54.0, read 10 Nov 2026
Last reviewed 10 Nov 2026.