Improving performance with Tesser
Kyle Kingsbury offers an overview of Tesser, a Clojure library for writing commutative, parallel folds that can be chained and composed into complex single-pass reductions that are dramatically faster on multicore systems and can be transparently distributed over Hadoop.
Talk Title | Improving performance with Tesser |
Speakers | Kyle Kingsbury (Jepsen) |
Conference | O’Reilly Velocity Conference |
Conf Tag | Building and maintaining complex distributed systems |
Location | San Jose, California |
Date | June 12-14, 2018 |
URL | Talk Page |
Slides | Talk Slides |
Video | |
Many computational problems involve combining information from many elements in a collection: summing and counting, parsing, filtering, limiting and faceting, finding distributions and covariance matrices, and so on. Where the collection can be divided into chunks, we can dramatically improve performance through parallelization. Kyle Kingsbury offers an overview of Tesser, a Clojure library for writing commutative, parallel folds that can be chained and composed into complex single-pass reductions that are dramatically faster on multicore systems and can be transparently distributed over Hadoop.