Cluster Computing and the Grid, IEEE International Symposium on (2008)
May 19, 2008 to May 22, 2008
In this paper, we consider the problem of developing service-oriented??implementations of data-intensive applications that process data on remote servers. While the existing grid and web-service frameworks allow interoperab ility and flexible resource utilization, achieving efficiency and scalability remains a critical challenge. Similarly,the existing grid and web-service frameworks do not provide transparency in accessing and processing data from grid-based data servers.We??present design and evaluation of a system that supports a high-level interface for developing data mining and scient ific data processing grid-services and targets data??residing on SRB servers. Results of our evaluation using two data mining and one scientific data processing applications show two important observations. First, each of applications we evaluated demonstrated good scalability with respect to dataset size, as well as changing numbers of both data host and compute nodes. Second, there is only a small??overhead associated wit hdeploying our middleware-based applications using MPICH-G2 and Globus. This overhead varied between 14% and 22%and is primarily because of a larger memory footprint. Thus, overall, our work shows that it is feasible to develop and deploy scalable and efficient??grid-services that process data from remote servers.
grid middleware, scalable remote datamining, MPICH-G2, Globus Toolkit
G. Agrawal and L. Glimcher, "A Middleware for Developing and Deploying Scalable Remote Mining Services," 2008 8th International Symposium on Cluster Computing and the Grid (CCGRID '08)(CCGRID), Lyon, 2008, pp. 242-249.