22nd International Conference on Data Engineering Workshops (ICDEW'06) Dealing with Overload in Distributed Stream Processing Systems Atlanta, Georgia April 03-April 07 ISBN: 0-7695-2571-7
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/ICDEW.2006.45
Overload management has been an important problem for large-scale dynamic systems. In this paper, we study this problem in the context of our Borealis distributed stream processing system. We show that server nodes must coordinate in their load shedding decisions to achieve global control on output quality. We describe a distributed load shedding approach which provides this coordination by upstream metadata aggregation and propagation. Metadata enables an upstream node to make fast local load shedding decisions which will influence its descendant nodes in the best possible way.
Citation:
Nesime Tatbul, Stan Zdonik, "Dealing with Overload in Distributed Stream Processing Systems," icdew, pp.24, 22nd International Conference on Data Engineering Workshops (ICDEW'06), 2006 Usage of this product signifies your acceptance of the Terms of Use. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||