Change-Aware Data Validation with Column-Level Lineage | Towards Data Science

Data transformation tools like dbt make constructing SQL data pipelines easy and systematic. But even with the added structure and clearly defined data models, pipelines can still become complex, w...

By · · 1 min read
Change-Aware Data Validation with Column-Level Lineage | Towards Data Science

Source: Towards Data Science

Data transformation tools like dbt make constructing SQL data pipelines easy and systematic. But even with the added structure and clearly defined data models, pipelines can still become complex, which makes debugging issues and validating changes to data models difficult.