October 27, 2019

259 words 2 mins read

Big data-fueled feedback loops leveraging streaming data in SDN/NFV

Big data-fueled feedback loops leveraging streaming data in SDN/NFV

Software-defined networking (SDN) and network functions virtualization (NFV) hold tremendous potential to enable efficiency and flexibility in service delivery, but SDN/NFV environments are also highly complex and multilayered. Matt Olson explains why effective support for SDN/NFV services requires leveraging the tremendous amount of service and data streaming from the platform.
Talk Title Big data-fueled feedback loops leveraging streaming data in SDN/NFV
Speakers Matt Olson (CenturyLink)
Conference Strata + Hadoop World
Conf Tag Big Data Expo
Location San Jose, California
Date March 29-31, 2016
URL Talk Page
Slides Talk Slides
Video

Software-defined networking (SDN) and network functions virtualization (NFV) hold tremendous potential to enable efficiency and flexibility in service delivery, but SDN/NFV environments are also highly complex and multilayered. Matt Olson explains why effective support for SDN/NFV services requires leveraging the tremendous amount of service and data streaming from the platform. The ultimate aim is to automate the processing of these data streams for near real-time feedback loops capable of effecting adaptive changes in the platform. However, the operational support for these platforms and the processes of developing these models require an environment in which subject-matter experts are able to access and explore the data in a flexible and controlled manner. Matt describes how CenturyLink is able to support a variety of use cases—ranging from interactive exploration of the data streams to the training and implementation of machine-learning models for the execution of automated feedback loops—through the use of an ecosystem that combines Hadoop, Spark, Hunk, and Splunk Enterprise. Matt explains how the ecosystem: This session is sponsored by Splunk.

software-defined network splunk automated streaming network function spark nfv sdn ecosystem hadoop network big data use case networking virtualization sdn/nfv data stream
comments powered by Disqus
IoT in the enterprise: A look at Intel (IoT) Inside

IoT in the enterprise: A look at Intel (IoT) Inside

October 23, 2019

Moty Fania shares Intels IT experience implementing an on-premises big data IoT platform for internal use cases. This unique platform was built on top of several open source technologies and enables highly scalable stream analytics with a stack of algorithms such as multisensor change detection, anomaly detection, and more.
How the oil and gas industry is igniting a spark with information fusion and metadata analytics

How the oil and gas industry is igniting a spark with information fusion and metadata analytics

October 24, 2019

Oil and gas organizations are at the forefront of big data, adopting technologies such as Hadoop and Spark to develop next-generation fusion systems. Brian Clark and Marco Ippolito introduce a case study from CGG, a builder of common data models to drive analytics of sensor data and associated metadata from fast-changing big data streams, to show how to derive richer value from big data assets.
Python scalability: A convenient truth

Python scalability: A convenient truth

October 21, 2019

Despite Python's popularity throughout the data-engineering and data science workflow, the principles behind its performance and scaling behavior are less understood. Travis Oliphant explains best practices and modern tools to scale Python to larger-than-memory and distributed workloads without sacrificing its ease of use or being forced to adopt heavyweight frameworks.
Real-time fraud detection using process mining with Spark Streaming

Real-time fraud detection using process mining with Spark Streaming

October 21, 2019

If you consider user click paths a process, you can apply process mining. Process mining models users based on their actual behavior, which allows us to compare new clicks with modeled behavior and report any inconsistencies. Bolke de Bruin and Hylke Hendriksen explain how ING implemented process mining on Spark Streaming, enabling real-time fraud detection.
Building machine-learning apps with Spark: MLlib, ML Pipelines, and GraphX (Half Day)

Building machine-learning apps with Spark: MLlib, ML Pipelines, and GraphX (Half Day)

October 27, 2019

Jayant Shekhar, Amandeep Khurana, Krishna Sankar, and Vartika Singh guide participants through techniques for building machine-learning apps using Spark MLlib and Spark ML and demonstrate the principles of graph processing with Spark GraphX.
Designing a scalable real-time data platform using Akka, Spark Streaming, and Kafka

Designing a scalable real-time data platform using Akka, Spark Streaming, and Kafka

October 26, 2019

Alex Silva outlines the implementation of a real-time analytics platform using microservices and a Scala stack that includes Kafka, Spark Streaming, Spray, and Akka. This infrastructure can process vast amounts of streaming data, ranging from video events to clickstreams and logs. The result is a powerful real-time data pipeline capable of flexible data ingestion and fast analysis.