December 26, 2019

170 words 1 min read

Intro to Ceph, the Distributed Storage System

Intro to Ceph, the Distributed Storage System

Ceph is an open source distributed object store, network block device, and file system designed for reliability, performance, and scalability. With an advanced placement algorithm, active storage node …
Talk Title Intro to Ceph, the Distributed Storage System
Speakers Gregory Farnum (Principal Software Engineer, Ceph, Red Hat)
Conference Open Source Summit Europe
Conf Tag
Location Prague, Czech Republic
Date Oct 21-27, 2017
URL Talk Page
Slides Talk Slides
Video

Ceph is an open source distributed object store, network block device, and file system designed for reliability, performance, and scalability. With an advanced placement algorithm, active storage nodes, and peer-to-peer gossip protocols, Ceph is software-defined storage for scaling from terabytes to exabytes with no single point of failure. Powerful features like instantaneous snapshotting and copy-on-write clones, along with self-management and automatic healing, make Ceph friendly to administrators and users. This talk introduces the Ceph architecture and features in the latest upstream Luminous release, focusing on enhancements to the RADOS Block Device and CephFS distributed filesystem — including new horizontal metadata scaling.

management reliability algorithm ceph open source cephfs network performance
comments powered by Disqus
Open vSwitch and OVN Project Updates

Open vSwitch and OVN Project Updates

December 16, 2019

Open vSwitch (OVS) is a multilayer open source virtual switch. OVS is designed to enable massive network automation through programmatic extension, while still supporting standard management interfac …
The state of Spark in the cloud

The state of Spark in the cloud

November 29, 2019

Nicolas Poggi evaluates the out-of-the-box support for Spark and compares the offerings, reliability, scalability, and price-performance from major PaaS providers, including Azure HDinsight, Amazon Web Services EMR, Google Dataproc, and Rackspace Cloud Big Data, with an on-premises commodity cluster as baseline.
IBM LinuxONE: The Largest Scalable Linux Server

IBM LinuxONE: The Largest Scalable Linux Server

December 23, 2019

The Modernization possibilities on the Most Scalable Compute Platform for Secure Data Driven Workloads Open source has become a hub for innovation. New use cases such as containers, new classes of dat …
How JupyterHub tamed big science: Experiences deploying Jupyter at a supercomputing center

How JupyterHub tamed big science: Experiences deploying Jupyter at a supercomputing center

December 22, 2019

Shreyas Cholia, Rollin Thomas, and Shane Canon share their experience leveraging JupyterHub to enable notebook services for data-intensive supercomputing on the Cray XC40 Cori system at the National Energy Research Scientific Computing Center (NERSC).
Benchmarking deep learning inference

Benchmarking deep learning inference

December 20, 2019

Artificial intelligence has had a tremendous impact on various applications at Baidu, including speech recognition and autonomous driving, although the performance requirements for all of these applications are very different. Sharan Narang outlines the challenges in inference for deep learning models and different workloads and performance requirements for various applications.
Conversational AI at large scale

Conversational AI at large scale

December 19, 2019

There has been a quantum leap in the performance of conversational AI. From speech recognition to machine translation and language understanding, deep learning made its mark. However, scaling and productizing these breakthroughs remains a big challenge. Yishay Carmiel shares techniques and tips on how to take advantage of large datasets, accelerate training, and create an end-to-end product.