Observability for data pipelines: Monitoring, alerting, and tracing lineage
January 27, 2020
Data-intensive applications, with many layers of transformations and movement from different data sources, can often be challenging to maintain and iterate even after they are initially built and validated. Jiaqi Liu explores how to factor in monitoring, alerting, and tracing data lineage when building data applications that move and transform data across multiple dependencies.