From ACID to CAP and back again: Making S3 reliable
Artifactorys use of hybrid storage has clear benefits, but what are the drawbacks? Fred Simon describes Artifactorys journey to find harmony between ACID and CAP. Fred reviews the challenges in building a reliable and atomic system on top of eventually consistent storage and explains how Artifactory solved them for both standalone and clustered architectures.
| Talk Title | From ACID to CAP and back again: Making S3 reliable |
| Speakers | Fred Simon (JFrog Inc) |
| Conference | O’Reilly Software Architecture Conference |
| Conf Tag | Engineering the Future of Software |
| Location | New York, New York |
| Date | April 11-13, 2016 |
| URL | Talk Page |
| Slides | Talk Slides |
| Video | |
Artifactory’s use of hybrid storage has clear benefits: while artifacts are stored on the file system in a layout-independent manner, all the metadata is kept in a fast and reliable indexed database. But how can you leverage a robust, clustered, and highly available storage solution like AWS-S3 and make it work with the metadata and other features of Artifactory? How do you couple eventually consistent storage like S3 with a strong storage consistency model required by your CI? Fred Simon describes Artifactory’s journey to find harmony between ACID and CAP. Fred reviews the challenges in building a reliable and atomic system on top of eventually consistent storage and explains how Artifactory solved them for both standalone and clustered architectures.
