This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Evaluating High-Performance Computing on Google App Engine
March-April 2012 (vol. 29 no. 2)
pp. 52-58
Radu Prodan, University of Innsbruck
Michael Sperk, University of Innsbruck
Simon Ostermann, University of Innsbruck
An experimental approach employs the Google App Engine (GAE) for high-performance parallel computing. A generic master-slave framework enables fast prototyping and integration of parallel algorithms that are transparently scheduled and executed on the Google cloud infrastructure. Compared to Amazon Elastic Compute Cloud (EC2), GAE offers lower resource-provisioning overhead and is cheaper for jobs shorter than one hour. Experiments demonstrated good scalability of a Monte Carlo simulation algorithm. Although this approach produced important speedup, two main obstacles limited its performance: middleware overhead and resource quotas.

1. D. Sanderson, Programming Google App Engine, O'Reilly Media, 2009.
2. A. Iosup et al., "Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing," IEEE Trans. Parallel and Distributed Systems, vol. 22, no. 6, 2011, pp. 931–945.
3. M. Sperk, "Scientific Computing in the Cloud with Google App Engine," master's thesis, Faculty of Mathematics, Computer Science, and Physics, Univ. of Innsbruck, 2011; http://dps.uibk.ac.at/~radusperk.pdf.
4. J.L. Gustafson, "Reevaluating Amdahl's Law," Comm. ACM, vol. 31, no. 5, 1988, pp. 532–533.
1. A. Iosup et al., "Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing," IEEE Trans. Parallel and Distributed Systems, vol. 22, no. 6, 2011, pp. 931–945.
2. A. Iosup, N. Yigitbasi, and D. Epema, "On the Performance Variability of Production Cloud Services," Proc. 11th IEEE/ACM Int'l Symp. Cluster, Cloud, and Grid Computing (CCGrid 11), IEEE CS, pp. 104–113.
3. C. Vecchiola, S. Pandey, and R. Buyya, "High-Performance Cloud Computing: A View of Scientific Applications," Proc. 10th Int'l Symp. Pervasive Systems, Algorithms, and Networks (ISPAN 09), IEEE CS, 2009, pp. 4–16.
4. J. Li et al., "eScience in the Cloud: A Modis Satellite Data Reprojection and Reduction Pipeline in the Windows Azure Platform," Proc. 2010 Int'l Symp. Parallel & Distributed Processing (IPDPS 10), IEEE CS, 2010, pp. 1–10.
5. C. Bunch, B. Drawert, and M. Norman, "MapScale: A Cloud Environment for Scientific Computing," tech. report, Computer Science Dept., Univ. of California, Santa Barbara, 2009; www.cs.ucsb.edu/~cgb/papersmapscale.pdf.
6. J. Qiu et al., "Hybrid Cloud and Cluster Computing Paradigms for Life Science Applications," BMC Bioinformatics, vol. 11, supplement 12, 2010, S3; www.biomedcentral.com/content/pdf1471-2105-11-s12-s3.pdf .
7. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters," Comm. ACM, vol. 51, no. 1, 2008, pp. 107–113.
8. J. Ekanayake and G. Fox, "High Performance Parallel Computing with Clouds and Cloud Technologies," Cloud Computing and Software Services: Theory and Techniques, S.A. Ahson, and M. Ilyas eds., CRC Press, 2010.

Index Terms:
cloud computing, high-performance computing, performance analysis, Google App Engine, GAE, Amazon Elastic Compute Cloud, Amazon EC2, software engineering
Citation:
Radu Prodan, Michael Sperk, Simon Ostermann, "Evaluating High-Performance Computing on Google App Engine," IEEE Software, vol. 29, no. 2, pp. 52-58, March-April 2012, doi:10.1109/MS.2011.131
Usage of this product signifies your acceptance of the Terms of Use.