Issue No. 04 - April (2017 vol. 28)
Rafael Tolosana-Calasanz , Departamento de Informática e Ingeniería de Sistemas, Universidad de Zaragoza, Zaragoza, Spain
Javier Diaz-Montes , Rutgers Discovery Informatics Institute, Rutgers University, New Brunswick, NJ
Omer F. Rana , School of Computer Science & Informatics, Cardiff University, Cardiff, United Kingdom
Manish Parashar , Rutgers Discovery Informatics Institute, Rutgers University, New Brunswick, NJ
Recent advances in sensor technologies and instrumentation have led to an extraordinary growth of data sources and streaming applications. A wide variety of devices, from smart phones to dedicated sensors, have the capability of collecting and streaming large amounts of data at unprecedented rates. A number of distinct streaming data models have been proposed. Typical applications for this include smart cites & built environments for instance, where sensor-based infrastructures continue to increase in scale and variety. Understanding how such streaming content can be processed within some time threshold remains a non-trivial and important research topic. We investigate how a cloud-based computational infrastructure can autonomically respond to such streaming content, offering Quality of Service guarantees. We propose an autonomic controller (based on feedback control and queueing theory) to elastically provision virtual machines to meet performance targets associated with a particular data stream. Evaluation is carried out using a federated Cloud-based infrastructure (implemented using CometCloud)-where the allocation of new resources can be based on: (i) differences between sites, i.e., types of resources supported (e.g., GPU versus CPU only), (ii) cost of execution; (iii) failure rate and likely resilience, etc. In particular, we demonstrate how Little's Law-a widely used result in queuing theory-can be adapted to support dynamic control in the context of such resource provisioning.
Cloud computing, Queueing analysis, Resource management, Distributed databases, Instruments, Feedback control, Process control
R. Tolosana-Calasanz, J. Diaz-Montes, O. F. Rana and M. Parashar, "Feedback-Control & Queueing Theory-Based Resource Management for Streaming Applications," in IEEE Transactions on Parallel & Distributed Systems, vol. 28, no. 4, pp. 1061-1075, 2017.