'All Roads Lead to Rome:' Optimistic Recovery for Distributed Iterative Data Processing

by Sebastian Schelter, Technische Universit├Ąt Berlin

October 8th 2013 @ 16:00, in Serraia

In this invited talk Sebastian Schelter will present his work about

All Roads Lead to Rome: Optimistic Recovery for Distributed Iterative Data Processing


In this work, we present a novel optimistic recovery strategy for distributed iterative algorithms. Our strategy does not require writing checkpoints and thus provides optimal failure-free performance with respect to the overhead induced by guaranteeing fault tolerance.

In case of a failure, we recreate a consistent state from which the algorithm will still converge through an easy-to-implement, user-defined function. This approach leverages the robust, self-correcting nature of a large class of fixpoint algorithms used in graph-mining and machine learning.


Sebastian Schelter is a PhD student from the Database Systems and Information Management Group (DIMA) of TU Berlin.