The Community for Technology Leaders
Green Image
Issue No. 07 - July (2009 vol. 20)
ISSN: 1045-9219
pp: 1038-1049
Patrick G. Bridges , University of New Mexico, Albuquerque
Arthur (Barney) B. Maccabe , University of New Mexico, Albuquerque
Julie Wenbin Zhu , Xilinx, Inc., Albuquerque
ABSTRACT
Understanding and tuning the performance of large-scale long-running applications is difficult, with both standard trace-based and statistical methods having substantial shortcomings that limit their usefulness. This paper describes a new performance monitoring approach called Embedded Gossip (EG) designed to enable lightweight online performance monitoring and tuning. EG works by piggybacking performance information on existing messages and performing information correlation online, giving each process in a parallel application a weakly consistent global view of the behavior of the entire application. To demonstrate the viability of EG, this paper presents the design and experimental evaluation of two different online monitoring systems and an online global adaptation system driven by Embedded Gossiping. In addition, we present a metric system for evaluating the suitability of an application to EG-based monitoring and adaptation, a general architecture for implementing EG-based monitoring systems, and a modified global commit algorithm appropriate for use in EG-based global adaptation systems. Together, these results demonstrate that EG is an efficient low-overhead approach for addressing a wide range of parallel performance monitoring tasks and that results from these systems can effectively drive online global adaptation.
INDEX TERMS
Lightweight performance monitoring, dynamic performance tuning, support for adaptation, parallel systems.
CITATION
Patrick G. Bridges, Arthur (Barney) B. Maccabe, Julie Wenbin Zhu, "Lightweight Online Performance Monitoring and Tuning with Embedded Gossip", IEEE Transactions on Parallel & Distributed Systems, vol. 20, no. , pp. 1038-1049, July 2009, doi:10.1109/TPDS.2008.126
91 ms
(Ver )