Continuous analytics: Integrating the data hub in a DevOps pipeline

Arturo Bayo and Alvaro Fernandez Velando explain how a data hub strategy helps clarify data sharing and governance in an organization and share one way to implement a data hub architecture using big data technology and resources that are already established in the enterprise.

Most organizations have already implemented a data-driven strategy or are planning to invest in one. However, these organizations often struggle to design an effective and efficient infrastructure to support use cases and derive business value through data. As a result, many organizations focus on the business case and build monolithic architectures that isolate their data from the rest of their applications, giving rise to siloed structures and adding complexity to the application lifecycle. Arturo Bayo and Alvaro Fernandez Velando explain how a data hub strategy helps clarify data sharing and governance in an organization and share one way to implement a data hub architecture using big data technology and resources that are already established in the enterprise. They then outline the design of a DevOps pipeline built on top of Docker containers capable of delivering continuous analytics through application lifecycle management tools. They conclude by exploring an analytic business case in production at Santander Spain that generates client networks connected by data stored in the data hub.