The Community for Technology Leaders
RSS Icon
Issue No.05 - May (2013 vol.39)
pp: 591-612
V. Nallur , Sch. of Comput. Sci., Univ. of Birmingham, Birmingham, UK
R. Bahsoon , Sch. of Comput. Sci., Univ. of Birmingham, Birmingham, UK
Cloud computing, with its promise of (almost) unlimited computation, storage, and bandwidth, is increasingly becoming the infrastructure of choice for many organizations. As cloud offerings mature, service-based applications need to dynamically recompose themselves to self-adapt to changing QoS requirements. In this paper, we present a decentralized mechanism for such self-adaptation, using market-based heuristics. We use a continuous double-auction to allow applications to decide which services to choose, among the many on offer. We view an application as a multi-agent system and the cloud as a marketplace where many such applications self-adapt. We show through a simulation study that our mechanism is effective for the individual application as well as from the collective perspective of all applications adapting at the same time.
Quality of service, Pricing, Reliability, Resource management, Measurement, Adaptation models, Cloud computing,multi-agent systems, Self-adaptation, market based
V. Nallur, R. Bahsoon, "A decentralized self-adaptation mechanism for service-based applications in the cloud", IEEE Transactions on Software Engineering, vol.39, no. 5, pp. 591-612, May 2013, doi:10.1109/TSE.2012.53
[1] M. Alrifai, D. Skoutas, and T. Risse, "Selecting Skyline Services for Qos-Based Web Service Composition," Proc. 19th Int'l Conf. World Wide Web, pp. 11-20, 2010.
[2] D. Ardagna and B. Pernici, "Global and Local QoS Constraints Guarantee in Web Service Selection," Proc. IEEE Int'l Conf. Web Services, pp. 805-806, 2005.
[3] L. Baresi, S. Guinea, and G. Tamburrelli, "Towards Decentralized Self-Adaptive Component-Based Systems," Proc. Int'l Workshop Software Eng. for Adaptive and Self-Managing Systems, pp. 57-64, 2008.
[4] B. Benatallah, M. Dumas, Q.Z. Sheng, and A.H.H. Ngu, "Declarative Composition and Peer-to-Peer Provisioning of Dynamic Web Services," Proc. 18th Int'l Conf. Data Eng., pp. 297-308, 2002.
[5] J.P. Brans and P. Vincke, "A Preference Ranking Organisation Method: The Promethee Method for Multiple Criteria Decision-Making," Management Science, vol. 31, no. 6, pp. 647-656, June 1985.
[6] I. Breskovic, C. Haas, S. Caton, and I. Brandic, "Towards Self-Awareness in Cloud Markets: A Monitoring Methodology," Proc. IEEE Int'l Conf. Dependable, Autonomic and Secure Computing, pp. 81 -88, Dec. 2011.
[7] R. Buyya and S. Pandey, "Cloudbus Toolkit for Market-Oriented Cloud Computing," Proc. First Int'l Conf. Cloud Computing, pp. 22-44, 2009.
[8] R. Buyya, C.S. Yeo, and S. Venugopal, "Market-Oriented Cloud Computing: Vision, Hype, and Reality for Delivering IT Services as Computing Utilities," Proc. 10th IEEE Int'l Conf. High Performance Computing and Comm., pp. 5-13, Sept. 2008.
[9] G. Canfora, M. Di Penta, R. Esposito, and M. Luisa Villani, "An Approach for QoS-Aware Service Composition Based on Genetic Algorithms," Proc. Conf. Genetic and Evolutionary Computation, pp. 1069-1075, 2005.
[10] J. Cardoso, A. Sheth, and J. Miller, "Workflow Quality of Service," technical report, Univ. of Georgia, Athens, Mar. 2002.
[11] J. Cardoso, A. Sheth, J. Miller, J. Arnold, and K. Kochut, "Quality of Service for Workflows and Web Service Processes," Web Semantics: Science, Services and Agents on the World Wide Web, vol. 1, no. 3, pp. 281-308, Apr. 2004.
[12] B. Cheng, R. De Lemos, H. Giese, and P. Inverardi, "Software Engineering for Self-Adaptive Systems: A Research Roadmap," Software Eng. for Self-Adaptive Systems, pp. 1-26, Springer-Verlag, 2009.
[13] S.-W. Cheng, D. Garlan, and B. Schmerl, "Architecture-Based Self-Adaptation in the Presence of Multiple Objectives," Proc. Int'l Workshop Self-Adaptation and Self-Managing Systems, pp. 2-8, 2006.
[14] S.W. Cheng and D. Garlan, "Making Self-Adaptation an Engineering Reality," Proc. Conf. Self-Star Properties in Complex Information Systems: Conceptual and Practical Foundations, pp. 158-173, 2005.
[15] S.H. Clearwater, R. Costanza, M. Dixon, and B. Schroeder, "Saving Energy Using Market-Based Control," Market-Based Control, pp. 253-273, World Scientific Publishing Co., 1996.
[16] D. Cliff, "Simple Bargaining Agents for Decentralized Market-Based Control," HP Laboratories technical report, 1998.
[17] CloudHarmony, "Do SLAs Really Matter? 1-Year Case Study," , 2012.
[18] G. Di Marzo Serugendo, M.-P. Gleizes, and A. Karageorgos, "Self-Organization in Multi-Agent Systems," The Knowledge Eng. Rev., vol. 20, no. 2, pp. 165-189, June 2005.
[19] E. DiNitto, C. Ghezzi, A. Metzger, M. Papazoglou, and K. Pohl, "A Journey to Highly Dynamic, Self-Adaptive Service-Based Applications," Automated Software Eng., vol. 15, nos. 3/4, pp. 313-341, Sept. 2008.
[20] L. Duboc, D. Rosenblum, and T. Wicks, "A Framework for Characterization and Analysis of Software System Scalability," Proc. Sixth Joint Meeting European Software Eng. Conf. and ACM SIGSOFT Symp. The Foundations of Software Eng., p. 375, 2007.
[21] T. Eymann, M. Reinicke, O. Ardaiz, P. Artigas, and L. Díaz de Cerio, F. Freitag, R. Messeguer, L. Navarro, D. Royo, and K. Sanjeevan, "Decentralized versus Centralized Economic Coordination of Resource Allocation in Grids," Proc. European Across Grids Conf., pp. 9-16, 2003.
[22] D. Freidman, "The Double Auction Market Institution: A Survey," The Double Auction Market Institutions, Theories and Evidence, Addison Wesley, 1993.
[23] D.K. G. and S. Sunder, "Allocative Efficiency of Markets with Zero-Intelligence Traders: Market as a Partial Substitute for Individual Rationality," J. Political Economy, vol. 101, no. 1, pp. 119-137, 1993.
[24] A. Gupta and D.O. Stahl, "The Economics of Network Management," Comm. ACM, vol. 42, no. 9, pp. 57-63, 1999.
[25] K. Harty and D. Cheriton, "A Market Approach to Operating System Memory Allocation," Market-Based Control, pp. 126-155, World Scientific Publishing Co., Inc., 1996.
[26] M. He and N.R. Jennings, "Southamptontac: An Adaptive Autonomous Trading Agent," ACM Trans. Internet Technology, vol. 3, pp. 218-235, Aug. 2003.
[27] M. He, N.R. Jennings, and H.-F. Leung, "On Agent-Mediated Electronic Commerce," IEEE Trans. Knowledge and Data Eng., vol. 15, no. 4, pp. 985-1003, July/Aug. 2003.
[28] Y.C. Ho, L. Servi, and R. Suri, "A Class of Center-Free Resource Allocation Algorithms," Large Scale Systems, vol. 1, pp. 51-62, 1980.
[29] "IBM: An Architectural Blueprint for Autonomic Computing," June 2006.
[30] "Amazon Inc. Amazon Spot-Instances," com/ec2spot-instances /, Dec. 2009.
[31] N. Jennings, "Automated Haggling: Building Artificial Negotiators," Proc. Sixth Pacific Rim Int'l Conf. Artificial Intelligence, p. 1, 2000.
[32] J.O. Kephart and D.M. Chess, "The Vision of Autonomic Computing," Computer, vol. 36, no. 1, pp. 41-50, Jan. 2003.
[33] P. Klemperer, "Auction Theory: A Guide to the Literature," J. Economic Surveys, vol. 13, no. 3, pp. 227-286, 1999.
[34] A. Koestler, The Ghost in the Machine. Penguin Group, 1989.
[35] M.M. Kokar and K. Baclawski, "Control Theory-Based Foundations of Self-Controlling Software," IEEE Intelligent Systems, vol. 14, no. 3, pp. 37-45, May/June 1999.
[36] R. Laddaga, "Creating Robust Software through Self-Adaptation," IEEE Intelligent Systems, vol. 14, no. 3, pp. 26-29, May/June 1999.
[37] M. Matsumoto and T. Nishimura, "Mersenne Twister: A 623-Dimensionally Equidistributed Uniform Pseudo-Random Number Generator," ACM Trans. Modeling Computer Simulation, vol. 8, pp. 3-30, Jan. 1998.
[38] A. Michlmayr, F. Rosenberg, P. Leitner, and S. Dustdar, "Comprehensive QoS Monitoring of Web Services and Event-Based SLA Violation Detection," Proc. Fourth Int'l Workshop Middleware for ServiceOriented Computing, pp. 1-6, 2009.
[39] V. Nallur and R. Bahsoon, "Design of a Market-Based Mechanism for Quality Attribute Tradeoff of Services in the Cloud," Proc. 25th ACM Symp. Applied Computing, 2010.
[40] J. Niu, K. Cai, S. Parsons, E. Gerding, and P. McBurney, "Characterizing Effective Auction Mechanisms: Insights from the 2007 TAC Market Design Competition," Proc. Seventh Int'l Conf. Autonomous Agents and Multiagent Systems, pp. 1079-1086, 2008.
[41] J. Niu, K. Cai, S. Parsons, P. McBurney, and E. Gerding, "What the 2007 TAC Market Design Game Tells Us Are Effective Auction Mechanisms," Autonomous Agents and Multi-Agent Systems, vol. 21, pp. 172-203, 2010.
[42] P. Oreizy, N. Medvidovic, and R.N. Taylor, "Architecture-Based Runtime Software Evolution," Proc. 20th Int'l Conf. Software Eng., pp. 177-186, 1998.
[43] A.E. Roth and I. Erev, "Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term," Games and Economic Behavior, vol. 8, no. 1, pp. 164-212, 1995.
[44] M. Salehie and L. Tahvildari, "Self-Adaptive Software," ACM Trans. Autonomous and Adaptive Systems, vol. 4, no. 2, pp. 1-42, May 2009.
[45] M. Stonebraker, R. Devine, M. Kornacker, W. Litwin, A. Pfeffer, A. Sah, and C. Staelin, "An Economic Paradigm for Query Processing and Data Migration in Mariposa," Proc. Third Int'l Conf. Parallel and Distributed Information Systems, pp. 58-67, 1994.
[46] P. Vytelingum, "The Structure and Behaviour of the Continuous Double Auction," PhD thesis, 2006.
[47] C.A. Waldspurger, T. Hogg, B.A. Huberman, J.O. Kephart, and W.S. Stornetta, "Spawn: A Distributed Computational Economy," IEEE Trans. Software Eng., vol. 18, no. 2, pp. 103-117, Feb. 1992.
[48] C.A. Waldspurger and W.E. Weihl, "Lottery Scheduling: Flexible Proportional-Share Resource Management," Proc. First USENIX Conf. Operating Systems Design and Implementation, p. 1, 1994.
[49] M.P. Wellman, "A Market-Oriented Programming Environment and Its Application to Distributed Multicommodity Flow Problems," J. Artificial Intelligent Research, vol. 1, no. 1, pp. 1-23, 1993.
[50] D. Weyns, S. Malek, and J. Andersson, "On Decentralized Self-Adaptation: Lessons from the Trenches and Challenges for the Future," Proc. ICSE Workshop Software Eng. for Adaptive and Self-Managing Systems, pp. 84-93, 2010.
[51] P.R. Wurman, "A Parametrization of the Auction Design Space," Games and Economic Behavior, vol. 35, nos. 1/2, pp. 304-338, Apr. 2001.
[52] L. Zeng, B. Benatallah, M. Dumas, J. Kalagnanam, and Q.Z. Sheng, "Quality Driven Web Services Composition," Proc. 12th Int'l Conf. World Wide Web, pp. 411-421, 2003.
[53] L. Zeng, B. Benatallah, P. Nguyen, and A.H.H. Ngu, "Agflow: Agent-Based Cross-Enterprise Workflow Management System," Proc. 27th Int'l Conf. Very Large Data Bases, pp. 697-698, 2001.
[54] L. Zeng, H. Lei, and H. Chang, "Monitoring the QoS For Web Services," Proc. Fifth Int'l Conf. Service-Oriented Computing, pp. 132-144, 2007.
[55] W. Zhang, C.K. Chang, T. Feng, and H.-y. Jiang, "QoS-Based Dynamic Web Service Composition with Ant Colony Optimization," Proc. IEEE 34th Ann. Computer Software and Applications Conf., pp. 493-502, July 2010.
[56] S.D. Ramchurn, D. Huynh, and N.R. Jennings, "Trust in Multi-Agent Systems," The Knowledge Eng. Rev., vol. 19, no. 1, pp. 1-25, 2005.
361 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool