Practical advice for driving down the cost of cloud big data platforms
Big data and cloud deployments return huge benefits in flexibility and economics but can also result in runaway costs and failed projects. Drawing on his production experience, Christopher Royles shares tips and best practices for determining initial sizing, strategic planning, and longer-term operation, helping you deliver an efficient platform, reduce costs, and implement a successful project.
Talk Title | Practical advice for driving down the cost of cloud big data platforms |
Speakers | Christopher Royles (Cloudera) |
Conference | Strata Data Conference |
Conf Tag | Making Data Work |
Location | London, United Kingdom |
Date | May 22-24, 2018 |
URL | Talk Page |
Slides | Talk Slides |
Video | |
Many organizations understand the value of the cloud and big data, and the current trend is to address both cloud and big data use cases as a combined project. These projects may start with a modest investment but can scale very quickly with overwhelming demand from the business and seemingly exponential increase in data volumes. The early stage of all projects requires an appropriate kickstart approach and seed investment, but understanding how to execute these initial pilots while keeping sight on a five-year TCO can be challenging for organizations with limited experience of either cloud or big data technologies. Successful projects maintain flexibility in deployment patterns, enabling tuning for workloads and data and continued optimization of resource use and costs. Driving projects from user need through a use-case catalogue can assist in managing the data ingest, management, governance, and exploitation of data. The use-case catalogue also assists in managing changing priorities and feeds into budgets and financial plans. Drawing on his experience with a range of successful production deployments on AWS and Azure, Christopher Royles offers an overview of the foundations of the minimum viable product (MVP), explains how to kickstart your project, and discusses how growth can be planned, managed, and budgeted effectively. You’ll learn how to effectively size an initial MVP as well as pragmatic methods of scaling to a five-year long-term foundation and growth plan. Along the way, Christopher also shares lessons learned and techniques for managing the initial funding and longer-term strategic budget and investment. Topics include: