Issue No.11 - November (2011 vol.22)
Jidong Zhai , Tsinghua University, Beijing
Tianwei Sheng , Tsinghua University, Beijing
Jiangzhou He , Tsinghua University, Beijing
Wenguang Chen , Tsinghua University, Beijing
Weimin Zheng , Tsinghua University, Beijing
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TPDS.2011.49
Communication patterns of parallel applications are important to optimize application performance and design better communication subsystems. Communication patterns can be extracted from communication traces. However, existing approaches to generate communication traces need to execute the entire parallel applications on full-scale systems that are time consuming and expensive. We propose a novel technique, called Fact, which can perform FAst Communication Traces collection for large-scale parallel applications on small-scale systems. Our idea is to reduce the original program to obtain a program slice through static analysis, and to execute the program slice to acquire the communication traces. Our idea is based on an observation that most computation and message contents in parallel applications are not relevant to their spatial and volume communication attributes, and therefore can be removed for the purpose of communication trace collection. We have implemented Fact and evaluated it with NPB programs and Sweep3D. The results show that Fact can reduce resource consumptions by two orders of magnitude in most cases.
Communication pattern, communication trace, message-passing program, parallel application.
Jidong Zhai, Tianwei Sheng, Jiangzhou He, Wenguang Chen, Weimin Zheng, "Efficiently Acquiring Communication Traces for Large-Scale Parallel Applications", IEEE Transactions on Parallel & Distributed Systems, vol.22, no. 11, pp. 1862-1870, November 2011, doi:10.1109/TPDS.2011.49