November 30, 2019

239 words 2 mins read

The business case for deep learning, Spark, and friends

The business case for deep learning, Spark, and friends

Deep learning is white-hot at the moment, but why does it matter? Developers are usually the first to understand why some technologies cause more excitement than others. Sanjay Mathur relates this insider knowledge, providing a tour through the hottest emerging data technologies of 2017 to explain why theyre exciting in terms of both new capabilities and the new economies they bring.
Talk Title The business case for deep learning, Spark, and friends
Speakers Sanjay Mathur (Silicon Valley Data Science)
Conference Strata Data Conference
Conf Tag Making Data Work
Location London, United Kingdom
Date May 23-25, 2017
URL Talk Page
Slides Talk Slides
Video

Technologies like deep learning are white-hot, but why do they matter? The secret power of today’s data technologies is that they promote economic scaling and flexible development patterns that can adapt to business needs—but industry hype has obscured much of the value to those approaching the topic. Skepticism is an understandable reaction. Developers are usually the first to understand why some technologies cause more excitement than others. Sanjay Mathur relates this insider knowledge, providing a tour through the hottest emerging data technologies of 2017 to explain why they’re exciting in terms of both new capabilities and the new economies they bring. Sanjay explores the emerging platforms of choice and explains where they fit into a complete data architecture and what they have to offer in terms of new capabilities, efficiencies, and economies of use. Topics include:

spark react deep learning math
comments powered by Disqus
Distinguish pop music from heavy metal using Apache Spark MLlib

Distinguish pop music from heavy metal using Apache Spark MLlib

November 25, 2019

Taras Matyashovsky explains how to use Apache Spark MLlib to build a supervised learning NLP pipeline to distinguish pop music from heavy metaland have fun in the process.
Stream all the things!

Stream all the things!

November 14, 2019

"Stream" is a buzzword for several things that share the idea of timely handling of neverending data. Big data architectures are evolving to be stream oriented. Microservice architectures are inherently message driven. Dean Wampler defines "stream" based on characteristics for such systems, using specific tools as examples, and argues that big data and microservices architectures are converging.
Leveraging deep learning to predict breast cancer proliferation scores with Apache Spark and Apache SystemML

Leveraging deep learning to predict breast cancer proliferation scores with Apache Spark and Apache SystemML

November 4, 2019

Estimating the growth rate of tumors is a very important but very expensive and time-consuming part of diagnosing and treating breast cancer. Michael Dusenberry and Frederick Reiss describe how to use deep learning with Apache Spark and Apache SystemML to automate this critical image classification task.
Semantic natural language understanding at scale using Spark, machine-learned annotators, and deep-learned ontologies

Semantic natural language understanding at scale using Spark, machine-learned annotators, and deep-learned ontologies

November 2, 2019

David Talby and Claudiu Branzan offer a live demo of an end-to-end system that makes nontrivial clinical inferences from free-text patient records. Infrastructure components include Kafka, Spark Streaming, Spark, and Elasticsearch; data science components include spaCy, custom annotators, curated taxonomies, machine-learned dynamic ontologies, and real-time inferencing.
Real-time machine learning with Redis, Apache Spark, TensorFlow, and more

Real-time machine learning with Redis, Apache Spark, TensorFlow, and more

November 30, 2019

Kamran Yousaf explains how to substantially accelerate and radically simplify common practices in machine learning, such as running a trained model in production, to meet real-time expectations, using Redis modules that natively store and execute common models generated by Spark ML and TensorFlow algorithms.
Reliable prediction: Handling uncertainty

Reliable prediction: Handling uncertainty

November 30, 2019

Reliable prediction is the ability of a predictive model to explicitly measure the uncertainty involved in a prediction without feedback. Robin Senge shares two approaches to measure different types of uncertainty involved in a prediction.