This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
StreamCloud: An Elastic and Scalable Data Streaming System
Dec. 2012 (vol. 23 no. 12)
pp. 2351-2365
Vincenzo Gulisano, Universidad Politécnica de Madrid, Madrid
Ricardo Jiménez-Peris, Universidad Politécnica de Madrid, Madrid
Marta Patiño-Martínez, Universidad Politécnica de Madrid, Madrid
Claudio Soriente, Universidad Politécnica de Madrid, Madrid
Patrick Valduriez, INRIA and LIRMM, University Montpellier 2, Montpellier
Many applications in several domains such as telecommunications, network security, large-scale sensor networks, require online processing of continuous data flows. They produce very high loads that requires aggregating the processing capacity of many nodes. Current Stream Processing Engines do not scale with the input load due to single-node bottlenecks. Additionally, they are based on static configurations that lead to either under or overprovisioning. In this paper, we present StreamCloud, a scalable and elastic stream processing engine for processing large data stream volumes. StreamCloud uses a novel parallelization technique that splits queries into subqueries that are allocated to independent sets of nodes in a way that minimizes the distribution overhead. Its elastic protocols exhibit low intrusiveness, enabling effective adjustment of resources to the incoming load. Elasticity is combined with dynamic load balancing to minimize the computational resources used. The paper presents the system design, implementation, and a thorough evaluation of the scalability and elasticity of the fully implemented system.
Index Terms:
Peer to peer computing,Semantics,Streaming media,Scalability,Load management,Cloud computing,Elasticity,elasticity,Data streaming,scalability
Citation:
Vincenzo Gulisano, Ricardo Jiménez-Peris, Marta Patiño-Martínez, Claudio Soriente, Patrick Valduriez, "StreamCloud: An Elastic and Scalable Data Streaming System," IEEE Transactions on Parallel and Distributed Systems, vol. 23, no. 12, pp. 2351-2365, Dec. 2012, doi:10.1109/TPDS.2012.24
Usage of this product signifies your acceptance of the Terms of Use.