December 27, 2019

245 words 2 mins read

Open source data persistence: Creating order from chaos

Open source data persistence: Creating order from chaos

Megan Kostick, Michael Brewer, and Manuel Silveyra explain how they tackle the issue of working across large distributed teams, share solutions to data persistence challenges, and offer an overview of their automated data model for bringing data from multiple teams into a single place in a consistent manner.

Talk Title Open source data persistence: Creating order from chaos
Speakers Megan Kostick (IBM), Michael Brewer (IBM), Manuel Silveyra (IBM)
Conference O’Reilly Open Source Convention
Conf Tag Put open source to work
Location Portland, Oregon
Date July 16-19, 2018
URL Talk Page
Slides Talk Slides
Video

Bringing data together all in one place in a consistent manner can be challenging. One team uses SQL, and another uses NoSQL, and yet another just keeps everything stored in a manual spreadsheet. Being able to automate and analyze the data while maintaining data persistence is key. Megan Kostick, Michael Brewer, and Manuel Silveyra explain how they tackle this issue and share solutions to data persistence challenges. They offer an overview of their automated data model for bringing data from multiple teams into a single place in a consistent manner, covering the multiple layers needed to ensure data persistence while cutting down on time-consuming manual data consolidation. Regardless of whether data comes from PostgreSQL, DB2, or MongoDB, users are able to create a unified and automated persistence layer through Elasticsearch that enables faster processing and read times. Join in to learn how to get started streamlining your data from multiple sources.

comments powered by Disqus