November 25, 2019

339 words 2 mins read

Get a farm-to-table view of your data: Track data lineage from source to analytics (sponsored by Syncsort)

Get a farm-to-table view of your data: Track data lineage from source to analytics (sponsored by Syncsort)

Chefs must be able to trust the authenticity, quality, and origin of their ingredients; data analysts must be able to do the same of their dataand what happens to it along the way. Tend Yourtu explains how to seamlessly track the lineage and quality of your dataon and off the cluster, on-premises or in the cloudto deliver meaningful insights and meet regulatory compliance requirements.

Talk Title Get a farm-to-table view of your data: Track data lineage from source to analytics (sponsored by Syncsort)
Speakers Tendu Yogurtcu (Syncsort)
Conference Strata Data Conference
Conf Tag Big Data Expo
Location San Jose, California
Date March 6-8, 2018
URL Talk Page
Slides Talk Slides
Video

Data isn’t static. Data starts in various systems, moves to other environments whether on-premises or in the cloud, changes, and combines to form new datasets. Just as good chefs must have a farm-to-table view of where their food comes from and what happened to it before reaching their kitchens, so too should analysts understand the provenance and quality of their data in order to trust their analyses and comply with governance and regulatory requirements. There are several tools to help with this, depending on where your data resides. Inside a cluster, technologies like Cloudera Navigator track the changes made to data. Outside the cluster, there are a number of technologies that can keep track of the quality of data, whether it adheres to certain rules, and what changes have been made. However, the reality is that data doesn’t exist in only one system. The challenge is having end-to-end visibility of your data as it moves from traditional systems like mainframes and EDWs to the cluster (i.e., from its source to its destination, and everything in between). Tendü Yoğurtçu explains how companies, including a leading financial services institution, are overcoming these challenges with enterprise data integration and data quality solutions that make lineage trackable, auditable, and available to you, from originating source to final target, regardless of what changed in between (and where). This session is sponsored by Syncsort.

comments powered by Disqus