Wes Chow (Mini) on Tiered Replication: A Cost-effective Alternative to Full Cluster Geo-replication
Meetup: http://bit.ly/2bB8fy3
Paper: http://bit.ly/2b2f2yV
Slides: http://bit.ly/2bBbKVj
Audio: http://bit.ly/2bltdQk
-----------------------------------------------------------------------------------------------------------
Sponsored by Two Sigma (@twosigma)
-----------------------------------------------------------------------------------------------------------
Description
------------------
Tiered Replication, by Cidon et. al, explores the problem of effective data replication strategies first introduced in the Copysets paper, awarded 2013 Usenix ATC Best Student Paper. While Copysets introduced a randomized algorithm for solving NP Hard redundancy and load balancing constraints around placement of data in distributed filesystem, Tiered Replication proposes a greedy algorithm for solving the same problem and also adding the ability to bake in real world constraints such as rack awareness. Wes will summarize the problem Copysets proposed, show Tiered Replication’s solution, and examine a real world deployment of the algorithm at Chartbeat.
Bio
-----
Wes Chow has a B.S. in Electrical Engineering & Computer Science from UC Berkeley. He spent eight years building technical infrastructure for high frequency trading shops. One day, he stared into his dark soul and realized he needed to move into the startup light. Thus S7 Labs sprang into being, and he led teams that built Storybox, a Seedcamp NY finalist, and Songza Radio, subsumed by Google Music. He's now at Chartbeat serving out his term as CTO.