Overview of Data Governance
Paco Nathan offers an overview of its history, themes, tools, process, standards, and morepartly based on interviewing experts in this field about issues and best practices. Join in to learn what impact machine learning has on data governance and vice versa, along with an overview of open source projects and open standards in this space.
|Talk Title||Overview of Data Governance|
|Speakers||Paco Nathan (derwen.ai)|
|Conference||O’Reilly Open Source Software Conference|
|Conf Tag||Fueling innovative software|
|Date||July 15-18, 2019|
Effective data governance is foundational for AI adoption in enterprise, but it’s an almost overwhelming topic. Paco Nathan offers an overview of its history, themes, tools, process, standards, and more—partly based on interviewing experts in this field about issues and best practices. Join in to learn what impact machine learning has on data governance and vice versa, along with an overview of open source projects and open standards in this space. On the one hand, poor data governance can lead to system data-quality issues, lack of data availability, and other risks, which means that the people within an organization cannot leverage data effectively, thus limiting ROI. On the other hand, there’s a galaxy of compliance issues aimed at preventing risks if people leverage data inappropriately. (While GDPR is popular in the new cycle there are many standards in play, depending on the business vertical.) However, other issues create drivers for data governance: how security concerns are reshaping the structure of web apps; ethics, bias, and others’ needs for ML transparency; the implications of “democratizing data and analytics” both pro and con; the priority for reproducibility in analytics workflows; and unexpected ways in which open source is evolving rapidly for highly regulated environments. Although many practices emerged from the era of data warehouses, big data changed the game and began drawing attention from regulators. Facebook, Twitter, and other tech giants now testify before US senators, who in turn struggle to grasp basic concepts in IT. Meanwhile the IT landscape is evolving rapidly: new forms of hardware and networking, serverless cloud offerings, and edge computing, for example, are redefining even the basic concepts related to data governance. Ultimately, risk management plays the “thin edge of the wedge” for these changes in enterprise, while the mantle of responsibility for data governance moves toward the emerging chief data officer role. Topics include: