18th International Parallel and Distributed Processing Symposium (IPDPS'04) - Workshop 1 An Execution-Time Estimation Model for Heterogeneous Clusters Santa Fe, New Mexico April 26-April 30 ISBN: 0-7695-2132-0
Heterogeneous clusters are flexible and cost-effective, but entail intrinsic difficulties in optimization. Although it is simple to invoke multiple processes on fast processing elements (PEs) to alleviate load imbalance, the optimum process allocation is not so obvious. Communication time is another problem. It is sometimes better to exclude slow PEs to avoid performance degradation, but it is generally difficult to find the optimal PE configuration. In this study, the execution time is first modeled from the measurement results of various configurations. Then, the derived model is used to estimate the optimal PE configuration and process allocation. We implemented the models from HPL (High Performance Linpack benchmark) of N = 400-6400, and estimated the optimal configuration for N = 3200-9600. The execution time of the estimated optimal configuration was 0%-3.6% longer than the actual optimal configuration. The models derived from N = 1600-6400 were also constructed, and their errors were 0%-4.3% for N = 1600-9600.
Citation:
Yoshinori Kishimoto, Shuichi Ichikawa, "An Execution-Time Estimation Model for Heterogeneous Clusters," ipdps, vol. 2, pp.105b, 18th International Parallel and Distributed Processing Symposium (IPDPS'04) - Workshop 1, 2004 Usage of this product signifies your acceptance of the Terms of Use. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||