The Community for Technology Leaders
2013 IEEE 5th International Conference on Cloud Computing Technology and Science (2011)
Athens, Greece
Nov. 29, 2011 to Dec. 1, 2011
ISBN: 978-0-7695-4622-3
pp: 511-516
ABSTRACT
In the recent years, cloud computing has emerged as the new IT paradigm that promises elastic resources on a pay-per-use basis. The challenges of cloud computing are focused around massive data storage and efficient large scale distributed computation. Hadoop, a community driven Apache project has provided an efficient and cost effective platform for large scale computation using the map-reduce methodology, pioneered by Google. In this paper, the design of a Hadoop-based data management system as the front-end service for Cloud data management is investigated. This framework is enriched with Restful APIs in front of Hadoop and a series of components that aim to extend Hadoop's functionality beyond its well known back-end, heavy data processing scope. These components are used to enrich security, logging and data analysis features and also data access compatibility between different but interconnected Cloud providers (federated Clouds). Hadoop capabilities are also extended in a quest for intelligent decision making regarding the choice of the fittest services for federation in a federated cloud scenario, in addition to legally compliant behaviour regarding the geographical location of data storage.
INDEX TERMS
Apache Hadoop, Cloud Computing, Data Management, Web Services
CITATION
Theodora Varvarigou, George Kousiouris, George Vafiadis, "A Front-end, Hadoop-based Data Management Service for Efficient Federated Clouds", 2013 IEEE 5th International Conference on Cloud Computing Technology and Science, vol. 00, no. , pp. 511-516, 2011, doi:10.1109/CloudCom.2011.76
172 ms
(Ver 3.3 (11022016))