This Article 
 Bibliographic References 
 Add to: 
Sapphire: Statistical Characterization and Model-Based Adaptation of Networked Applications
December 2006 (vol. 17 no. 12)
pp. 1512-1525

Abstract—Many modern networked applications require specific levels of service quality from the underlying network. Moreover, next-generation networked applications are expected to adapt to changes in the underlying network, services, and user interactions. While some applications have built-in adaptivity, the adaptation itself requires specification of a system model. This paper presents Sapphire, an experimental approach for systematic model generation for application adaptation within a target network. It employs a nearly-automated, statistical design of experiments to characterize the relationships of both application and network-level parameters. First, it applies the Analysis of Variance (ANOVA) method to identify the most significant parameters and their interactions that affect performance. Next, it generates a model of application performance with respect to these parameters within the ranges of measurements. The key benefit of the framework is the integration of several well-established concepts of statistical modeling and distributed systems in the form of simple APIs so that existing applications can take advantage of it. We demonstrate the usefulness and flexibility of Sapphire by generating a performance model of an audio streaming application. We show that many existing multimedia and QoS-sensitive applications can exploit a statistical modeling approach such as Sapphire to incorporate application adaptivity. The approach can also be used for feedback control of distributed applications, tuning network and application parameters to achieve service levels in a target network.

[1] M. El-Gendy, A. Bose, H. Wang, and K.G. Shin, “Statistical Characterization of Per-Node QoS,” Proc. 11th IEEE Int'l Workshop Quality of Service (IWQoS), June 2003.
[2] Fidelia NetVigil Version 3.5, http:/, 2006.
[3] “Mercury Interactive Topaz Application Performance Management,” http:/, 2006.
[4] L.A. DaSilva, “QoS Mapping Along the Protocol Stack—Discussion and Preliminary Results,” Proc. IEEE Int'l Conf. Comm. (ICC), June 2000.
[5] K. Nahrstedt and J.M. Smith, “An Application-Driven Approach to Networked Multimedia Systems,” Proc. 18th Ann. Conf. Local Area Computer Networks, pp. 361-368, 1993.
[6] J. Huard and A. Lazar, “On QoS Mapping in Multimedia Networks,” Proc. 21st IEEE Int'l Computer Software and Application Conf. (COMPSAC), 1997.
[7] B.H. Liu, P. Ray, and S. Jha, “Mapping Distributed Application SLA to Network QoS Parameters,” Proc. 10th IEEE Int'l Conf. Telecomm. (ICT), 2003.
[8] J. Bolot and A. Vega-Garcia, “Control Mechanisms for Packet Audio in the Internet,” Proc. INFOCOM, pp. 232-239, 1996.
[9] T. Urabe, H. Afzal, G. Ho, P. Pancha, and M. El Zarki, “MPEGTool: An X-Window-Based MPEG Encoder and Statistics Tool,” Proc. ACM Multimedia Conf., pp. 259-266, 1993.
[10] S. Blake, D. Black, M. Carlson, E. Davis, Z. Wang, and W. Weiss, “An Architecture for Differentiated Services,” RFC 2475, IETF, Dec. 1998.
[11] K. Nichols, V. Jacobson, and L. Zhang, “A Two-Bit Differentiated Services Architecture for the Internet,” RFC 2638, IETF, July 1999.
[12] Schulzrinne, Casner, Frederick, Jacobson, “RTP: A Transport Protocol for Real-Time Applications,” IETF RFC 3550, Network Working Group, 2003.
[13] N. Kitawaki, “Perceptual QoS Assessment Methodologies for Coded Speech in Networks,” Proc. IEEE Workshop Speech Coding, 2002.
[14] F. Hammer, P. Reichl, and T. Ziegler, “Where Packet Traces Meet Speech Samples: An Instrumental Approach to Perceptual QoS Evaluation of VOIP,” Proc. 12th IEEE Int'l Workshop Quality of Service (IWQOS), pp. 273-280, 2004.
[15] B.C. Neuman and S.S. Augart, “Prospero: A Base for Building Information Infrastructure, ” Proc. Int'l Networking Conf. Internet Soc. (INET '93), 1993.
[16] L. Lamport, “Time, Clocks, and the Ordering of Events in a Distributed System,” Comm. ACM, vol. 21, no. 7, 1978.
[17] Extensible Markup Language (XML), http://www.w3.orgXML/, 2006.
[18] R. Schwarz and F. Mattern, “Detecting Causal Relationships in Distributed Computations: In Search of the Holy Grail,” Distributed Computing, vol. 7, no. 3, pp. 149-174, 1994.
[19] R. Jain, The Art of Computer Systems Performance Analysis. John Wiley & Sons, Inc., 1991.
[20] J. Neter, W. Wasserman, and M. Kutner, Applied Linear Statistical Models: Regression, Analysis of Variance, and Experimental Designs. R.D. Irwin, Inc., 1985.
[21] R.Y. Liu, “Bootstrap Procedures under Some Non-i.i.d. Models,” Annals of Statistics, vol. 16, 1998.
[22] U. Hengartner, J. Bolliger, and T. Gross, “TCP Vegas Revisited,” Proc. IEEE INFOCOM '00, Mar. 2000.
[23] B. Li and K. Nahrstedt, “A Control-Based Middleware Framework for Quality of Service Adaptations,” IEEE J. Selected Areas in Comm., Sept. 1999.
[24] L. Abeni and G. Buttazzo, “Hierarchical QoS Management for Time Sensitive Applications,” Proc. IEEE Real-Time Technology and Applications Symp., 2001.
[25] F. Chang and V. Karamcheti, “Automatic Configuration and Run-Time Adaptation of Distributed Applications,” Proc. Ninth IEEE Int'l Symp. High Performance Distributed Computing (HPDC), 2000.
[26] B. Landfeldt, A. Seneviratne, and C. Diot, “User Service Assistant: An End-to-End Reactive QoS Architecture,” Proc. Sixth IEEE Int'l Workshop Quality of Service (IWQoS), May 1998.
[27] T.F. Abdelzaher, “An Automated Profiling Subsystem for QoS-Aware Services,” Proc. IEEE Real Time Technology and Applications Symp., pp. 208-217, 2000.
[28] R. Zhang, C. Lu, T. Abdelzaher, and J. Stankovic, “Controlware: A Middleware Architecture for Feedback Control of Software Performance,” July 2002.
[29] M.W. Mutka, A. Bakic, and D.T. Rover, “BRISK: A Portable and Flexible Distributed Instrumentation System,” Proc. 13th Int'l Parallel Processing Symp., 1999.
[30] V. Taylor, X. Wu, and R. Stevens, “Design and Implementation of Prophesy Automatic Instrumentation and Data Entry System,” Proc. 13th IASTED Int'l Conf. Parallel and Distributed Computing and Systems (PDCS '01), 2001.
[31] V. Adve, V.V. Lam, and B. Ensink, “Language and Compiler Support for Adaptive Distributed Applications,” Proc. ACM SIGPLAN Workshop Languages, Compilers, and Tools for Embedded Systems, 2001.
[32] D. Gunter, B. Tierney, K. Jackson, J. Lee, and M. Stoufer, “Dynamic Monitoring of High-Performance Distributed Applications,” Proc. 11th IEEE Int'l Symp. High Performance Distributed Computing (ISHPDC), 2002.
[33] B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad, M. Newbold, M. Hibler, C. Barb, and A. Joglekar, “An Integrated Experimental Environment for Distributed Systems and Networks,” Proc. Fifth Symp. Operating Systems Design and Implementation, pp. 255-270, Dec. 2002.
[34] Q. He and K. Schwan, “IQ-RUDP: Coordinating Application Adaptation with Network Transport,” Proc. 11th IEEE Int'l Symp. High Performance Distributed Computing, 2002.
[35] G.R. Malan and F. Jahanian, “An Extensible Probe Architecture for Network Protocol Performance Measurement,” Proc. ACM SIGCOMM, 1998.
[36] S. Yemini, S. Kliger, E. Mozes, Y. Yemini, and D. Ohsie, “High Speed and Robust Event Correlation,” IEEE Comm. Magazine, vol. 34, 1996.
[37] S. Dawson and F. Jahanian, “Probing and Fault Injection of Protocol Implementations,” Proc. Int'l Conf. Distributed Computer Systems, May 1995.
[38] R. Chandra, R.M. Lefever, M. Cukier, and W.H. Sanders, “Loki: A State-Driven Fault Injector for Distributed Systems,” Proc. Int'l Conf. Dependable Systems and Networks (DSN), 2000.

Index Terms:
Application-aware adaptation, measurements, statistical analysis, performance analysis.
Abhijit Bose, Mohamed El Gendy, Kang G. Shin, "Sapphire: Statistical Characterization and Model-Based Adaptation of Networked Applications," IEEE Transactions on Parallel and Distributed Systems, vol. 17, no. 12, pp. 1512-1525, Dec. 2006, doi:10.1109/TPDS.2006.177
Usage of this product signifies your acceptance of the Terms of Use.