December 9, 2019

192 words 1 min read

The Netflix data platform: Now and in the future

The Netflix data platform: Now and in the future

The Netflix data platform is constantly evolving, but fundamentally it's an all-cloud platform at a massive scale (40+ PB and over 700 billion new events per day) focused on empowering developers. Kurt Brown dives into the current technology landscape at Netflix and offers some thoughts on what the future holds.
Talk Title The Netflix data platform: Now and in the future
Speakers
Conference Strata + Hadoop World
Conf Tag Make Data Work
Location New York, New York
Date September 27-29, 2016
URL Talk Page
Slides Talk Slides
Video

The Netflix data platform is constantly evolving, but fundamentally it’s an all-cloud platform at a massive scale (40+ PB and over 700 billion new events per day) focused on empowering developers. Kurt Brown dives into the current technology landscape at Netflix and offers some thoughts on what the future holds. Kurt covers key technologies, such as Spark, Presto, Docker, and Jupyter, along with many broader data ecosystem facets (metadata, insights into jobs run, visualizing big data, etc.) and considerations (such as accessibility and necessary compromises). You’ll leave with greater insight into how things work at Netflix and be inspired to re-envision your data platform.

spark ecosystem netflix jupyter big data docker cloud
comments powered by Disqus
Stream analytics in the enterprise: A look at Intels internal IoT implementation

Stream analytics in the enterprise: A look at Intels internal IoT implementation

November 17, 2019

Moty Fania shares Intels IT experience implementing an on-premises IoT platform for internal use cases. The platform was based on open source big data technologies and containers and was designed as a multitenant platform with built-in analytical capabilities. Moty highlights the key lessons learned from this journey and offers a thorough review of the platforms architecture.
IoT in the enterprise: A look at Intel (IoT) Inside

IoT in the enterprise: A look at Intel (IoT) Inside

October 23, 2019

Moty Fania shares Intels IT experience implementing an on-premises big data IoT platform for internal use cases. This unique platform was built on top of several open source technologies and enables highly scalable stream analytics with a stack of algorithms such as multisensor change detection, anomaly detection, and more.
Yellow Pages (Canada): Our journey to speed of thought interactive analytics on top of Hadoop

Yellow Pages (Canada): Our journey to speed of thought interactive analytics on top of Hadoop

December 7, 2019

The self-service YP Analytics application allows advertisers to understand their digital presence and ROI. Richard Langlois explains how Yellow Pages used this expertise for an internal use case that delivers real-time analytics with Tableau, using OLAP on Hadoop and enabled by its stack, which includes HDFS, Parquet, Hive, Impala, and AtScale, for fast, real-time analytics and data exploration.
Petascale genomics

Petascale genomics

November 17, 2019

The advent of next-generation DNA sequencing technologies is revolutionizing life sciences research by routinely generating extremely large datasets. Tom White explains how big data tools developed to handle large-scale Internet data (like Hadoop) help scientists effectively manage this new scale of data and also enable addressing a host of questions that were previously out of reach.
Innovating out in the open

Innovating out in the open

November 10, 2019

It's almost been a year since the Open Container Initiative (OCI) and its reference OCI-compliant runtime for containers, runC, were announced last June. RunC is now the container execution engine used both by Docker and Cloud Foundry's Garden-Linux project. Phil Estes explains why runC and the OCI community are great places to innovate and develop new features for container execution.
Think outside the container

Think outside the container

November 3, 2019

There is much more to Docker than just deploying your flagship application. Carolyn VanSlyck, Ash Wilson, and Nick Silkey look at three use cases for Docker that go beyond the typical software development pipeline. You'll leave knowing how you can use Docker on the side, even if you haven't tackled Dockerizing your application.