'All Roads Lead to Rome:' Optimistic Recovery for Distributed Iterative Data Processing
by Sebastian Schelter, Technische Universität Berlin
October 8th 2013 @ 16:00, in Serraia
In this invited talk Sebastian Schelter will present his work about
All Roads Lead to Rome: Optimistic Recovery for Distributed Iterative Data Processing
Abstract:
In this work, we present a novel optimistic recovery strategy for distributed iterative algorithms. Our strategy does not require writing checkpoints and thus provides optimal failure-free performance with respect to the overhead induced by guaranteeing fault tolerance.
In case of a failure, we recreate a consistent state from which the algorithm will still converge through an easy-to-implement, user-defined function. This approach leverages the robust, self-correcting nature of a large class of fixpoint algorithms used in graph-mining and machine learning.