The SMACK stack on Mesosphere DC/OS using cloud infrastructure
John Dohoney and Kaitlin Carter walk you through deploying the SMACK stack on DC/OS. This architecture enables you to create modern streaming applications that make use of NoSQL databases with Cassandra and message streaming with Apache Kafka using analytics streaming with Apache Spark, all running under Apache Mesos implemented with Akka streaming and asynchronous Java libraries under DC/OS.
Talk Title | The SMACK stack on Mesosphere DC/OS using cloud infrastructure |
Speakers | John Dohoney (Mesosphere), Kaitlin Carter (Mesosphere) |
Conference | O’Reilly Open Source Convention |
Conf Tag | Put open source to work |
Location | Portland, Oregon |
Date | July 16-19, 2018 |
URL | Talk Page |
Slides | Talk Slides |
Video | |
Economic growth is currently dominated by companies transforming how we live our lives with highly personalized, data-informed, real-time interactions. For the first time in recent history, 7 of the 10 most valuable companies in the world are internet giants. Their success comes partly from being able to develop globally scalable application infrastructure to provide individualized experiences that support and fulfill, surprise and delight, and inform and entertain. To regain a competitive edge, most traditional enterprises need to emulate these capabilities using the same tools that power the internet giants. However, due to obsolete skills and fear of change, they find the requirements needed to support those solutions, such as unfamiliar cloud-native infrastructure, tools, and techniques, difficult. Many of the patterns and tools developed and used by technology companies have been democratized through open source and cloud tools. Google designed Kubernetes, drawing on its decade-long experience with container orchestration; Facebook built the Cassandra distributed database to provide massive backend scale; and LinkedIn created Kafka to handle the massive scale for distributed message-based applications, while on the management side, Twitter showed the world how to improve user experience using Apache Mesos to pool and automate running containerized data intensive applications. As a result, all of the once-closed capabilities of the Silicon Valley elite are now widely available and supported. Given the know-how, anyone can leverage these tools to tap into the near limitless capacity of cloud-native applications. John Dohoney and Kaitlin Carter walk you through deploying the SMACK stack on DC/OS. This architecture enables you to create modern streaming applications that make use of NoSQL databases with Cassandra and highly reliable message streaming with Apache Kafka using analytics streaming with Apache Spark, all running under Apache Mesos implemented with Akka streaming and asynchronous Java libraries under DC/OS. The tutorial will be conducted on cloud instances using AWS.