The Community for Technology Leaders
2015 31st IEEE International Conference on Data Engineering Workshops (ICDEW) (2015)
Seoul, South Korea
April 13, 2015 to April 17, 2015
ISBN: 978-1-4799-8442-8
pp: 34-41
Simin You , Dept. of Computer Science, CUNY Graduate Center, New York, USA
Jianting Zhang , Dept. of Computer Science, The City College of New York, USA
Le Gruenwald , Dept. of Computer Science, The University of Oklahoma, Norman, USA
ABSTRACT
The rapidly increasing amount of location data available in many applications has made it desirable to process their large-scale spatial queries in Cloud for performance and scalability. We report our designs and implementations of two prototype systems that are ready for Cloud deployments: SpatialSpark based on Apache Spark and ISP-MC based on Cloudera Impala. Both systems support indexed spatial joins based on point-in-polygon test and point-to-polyline distance computation. Experiments on the pickup locations of ∼170 million taxi trips in New York City and ∼10 million global species occurrences records have demonstrated both efficiency and scalability using Amazon EC2 clusters.
INDEX TERMS
Sparks, Spatial databases, Query processing, Hardware, Scalability, Data processing, Filtering
CITATION
Simin You, Jianting Zhang, Le Gruenwald, "Large-scale spatial join query processing in Cloud", 2015 31st IEEE International Conference on Data Engineering Workshops (ICDEW), vol. 00, no. , pp. 34-41, 2015, doi:10.1109/ICDEW.2015.7129541
153 ms
(Ver 3.3 (11022016))