The Community for Technology Leaders
21st International Conference on Data Engineering (ICDE'05) (2005)
Tokyo, Japan
Apr. 5, 2005 to Apr. 8, 2005
ISSN: 1084-4627
ISBN: 0-7695-2285-8
pp: 779-790
Jeong-Hyon Hwang , Brown University
Magdalena Balazinska , Massachussets Institute of Technology
Alexander Rasin , Brown University
Uğur Çetintemel , Brown University
Michael Stonebraker , Massachussets Institute of Technology
Stan Zdonik , Brown University
ABSTRACT
<p>Stream-processing systems are designed to support an emerging class of applications that require sophisticated and timely processing of high-volume data streams, often originating in distributed environments. Unlike traditional data-processing applications that require precise recovery for correctness, many stream-processing applications can tolerate and benefit from weaker recovery guarantees. In this paper, we study various recovery guarantees and pertinent recovery techniques that can meet the correctness and performance requirements of stream-processing applications.</p> <p>We discuss the design and algorithmic challenges associated with the proposed recovery techniques and describe how each can provide different guarantees with proper combinations of redundant processing, checkpointing, and remote logging. Using analysis and simulations, we quantify the cost of our recovery guarantees and examine the performance and applicability of the recovery techniques. We also analyze how the knowledge of query network properties can help decrease the cost of high availability.</p>
INDEX TERMS
null
CITATION

M. Stonebraker, J. Hwang, M. Balazinska, A. Rasin, U. Çetintemel and S. Zdonik, "High-Availability Algorithms for Distributed Stream Processing," 21st International Conference on Data Engineering (ICDE'05)(ICDE), Tokyo, Japan, 2005, pp. 779-790.
doi:10.1109/ICDE.2005.72
95 ms
(Ver 3.3 (11022016))