December 2, 2019

110 words 1 min read

Lessons learned working with Spark and Cassandra

Lessons learned working with Spark and Cassandra

Matthias Niehoff shares lessons learned working with Spark, Cassandra, and the Spark-Cassandra connector and best practices drawn from his work on multiple big and fast data projects, as well as challenges encountered along the way.
Talk Title Lessons learned working with Spark and Cassandra
Speakers Matthias Niehoff (codecentric AG)
Conference Strata Data Conference
Conf Tag Making Data Work
Location London, United Kingdom
Date May 23-25, 2017
URL Talk Page
Slides Talk Slides
Video

Matthias Niehoff shares lessons learned working with Spark, Cassandra, and the Spark-Cassandra connector and best practices drawn from his work on multiple big and fast data projects, as well as challenges encountered along the way. Topics include:

cassandra spark
comments powered by Disqus
Big data for operational insights

Big data for operational insights

November 9, 2019

GoDaddy ingests and analyzes 100,000 EPS of logs, metrics, and events each day. Felix Gorodishter shares GoDaddy's big data journey and explains how the company makes sense of 10+-TB-per-day growth for operational insights of its cloud leveraging Kafka, Hadoop, Spark, Pig, Hive, Cassandra, and Elasticsearch.
How to secure Apache Spark?

How to secure Apache Spark?

December 2, 2019

Security has been a large and growing aspect of distributed systems, specifically in the big data ecosystem, but it's an underappreciated topic within the Spark framework itself. Neelesh Srinivas Salian explains how detailed knowledge of setting up security and an awareness of what to be looking out for in terms of problems and issues can help an organization move forward in the right way.
Making recommendations using graphs and Spark

Making recommendations using graphs and Spark

December 2, 2019

Harry Powell and Raffael Strassnig demonstrate how to model unobserved customer preferences over businesses by thinking about transactional data as a bipartite graph and then computing a new similarity metricthe expected degrees of separationto characterize the full graph.
Meta-data science: When all the world's data scientists are just not enough

Meta-data science: When all the world's data scientists are just not enough

December 1, 2019

What if you had to build more models than there are data scientists in the worlda feat enterprise companies serving hundreds of thousands of businesses often have to do? Leah McGuire offers an overview of Salesforce's general-purpose machine-learning platform that automatically builds per-company optimized models for any given predictive problem at scale, beating out most hand-tuned models.
Real-time machine learning with Redis, Apache Spark, TensorFlow, and more

Real-time machine learning with Redis, Apache Spark, TensorFlow, and more

November 30, 2019

Kamran Yousaf explains how to substantially accelerate and radically simplify common practices in machine learning, such as running a trained model in production, to meet real-time expectations, using Redis modules that natively store and execute common models generated by Spark ML and TensorFlow algorithms.
Reliable prediction: Handling uncertainty

Reliable prediction: Handling uncertainty

November 30, 2019

Reliable prediction is the ability of a predictive model to explicitly measure the uncertainty involved in a prediction without feedback. Robin Senge shares two approaches to measure different types of uncertainty involved in a prediction.