January 1, 2020

160 words 1 min read

Implementing a successful real-time project

Implementing a successful real-time project

DHL's Javier Esplugas and Conduce's Kevin Parent explain how the two companies have implemented an IoT pipeline that gives managers and executives real-time insight into warehouse operations, helping them to identify potential hazards, reduce costs, and increase productivity.
Talk Title Implementing a successful real-time project
Speakers Javier Esplugas (DHL Supply Chain), Kevin Parent (Conduce)
Conference Strata Data Conference
Conf Tag Make Data Work
Location New York, New York
Date September 26-28, 2017
URL Talk Page
Slides Talk Slides
Video

Many projects dealing with real-time data fail, due to issues with managing data, identifying use cases and applications, and determining the right context for the data that’s collected. DHL’s Javier Esplugas and Conduce’s Kevin Parent explain how the two companies have implemented an IoT pipeline that gives managers and executives real-time insight into warehouse operations, helping them to identify potential hazards, reduce costs, and increase productivity, and share practical tips for preparing and scaling a real-time streaming data project for success.

pipeline streaming use case iot
comments powered by Disqus
MacroBase: A search engine for fast data streams

MacroBase: A search engine for fast data streams

December 31, 2019

Sahaana Suri offers an overview of MacroBase, a new analytics engine from Stanford designed to prioritize the scarcest resource in large-scale, fast-moving data streams: human attention. MacroBase allows reconfigurable, real-time root-cause analyses that have already diagnosed issues in production streams in mobile, data center, and industrial applications.
State-of-the-art robot predictive maintenance with real-time sensor data

State-of-the-art robot predictive maintenance with real-time sensor data

December 30, 2019

Mateusz Dymczyk and Mathieu Dumoulin showcase a working, practical, predictive maintenance pipeline in action and explain how they built a state-of-the-art anomaly detection system using big data frameworks like Spark, H2O, TensorFlow, and Kafka on the MapR Converged Data Platform.
Unified, portable, efficient: Batch and stream processing with Apache Beam (incubating)

Unified, portable, efficient: Batch and stream processing with Apache Beam (incubating)

October 31, 2019

Unbounded, out-of-order, global-scale data is now the norm. Even for the same computation, each use case entails its own balance between completeness, latency, and cost. Kenneth Knowles shows how Apache Beam gives you control over this balance in a unified programming model that is portable to any Beam runner, including Apache Spark, Apache Flink, and Google Cloud Dataflow.
Mistakes were made, but not by us: Lessons from a year of supporting Apache Kafka

Mistakes were made, but not by us: Lessons from a year of supporting Apache Kafka

December 31, 2019

Dustin Cote shares his experience troubleshooting Apache Kafka in production environments and explains how to avoid pitfalls like message loss or performance degradation in your environment.
Rumpelstiltskin and the financial markets

Rumpelstiltskin and the financial markets

December 30, 2019

Can you really use unstructured data as part of your investment process? Why are leading financial services firms building practices to handle all sorts of data from satellite to browsing? Is the IoT a significant data point for financial analysis? Rob Passarella explores current applications and use cases for data, which financial services firms are eagerly gobbling up with alpha in mind.
Spark camp: Apache Spark 2.0 for analytics and text mining with Spark ML

Spark camp: Apache Spark 2.0 for analytics and text mining with Spark ML

December 30, 2019

Brooke Wenig introduces you to Apache Spark 2.0 core concepts with a focus on Spark's machine learning library, using text mining on real-world data as the primary end-to-end use case.