Working with cloud filesystems: From semantics to application
Sean Mackrory offers an overview of and best practices for filesystems in public cloud infrastructures as they relate to traditional filesystems. Many of the examples will relate to Hadoop, namely moving from HDFS to S3.
| Talk Title | Working with cloud filesystems: From semantics to application |
| Speakers | Sean Mackrory (Cloudera) |
| Conference | O’Reilly Open Source Convention |
| Conf Tag | Making Open Work |
| Location | Austin, Texas |
| Date | May 8-11, 2017 |
| URL | Talk Page |
| Slides | Talk Slides |
| Video | |
What’s in a filesystem? Whether you’re building a new application in a public cloud such as AWS, Azure, or GCE, porting an existing application to use a cloud file store, or adjusting your code to interact with a cloud-native file store, there is a lot to consider. Sean Mackrory offers an overview of and best practices for filesystems in public cloud infrastructures as they relate to traditional filesystems. Sean explores some of the considerations with filesystems such as Amazon’s S3, as well as network-attached storage, such as EBS or Microsoft’s SSD-backed premium storage. Many of the examples will relate to Hadoop, namely moving from HDFS to S3. You’ll leave with a map to navigate the waters, based on the testing, tuning, and best practices that ensure that your application and cloud filesystem will work together well.
