The Community for Technology Leaders
2013 IEEE 29th International Conference on Data Engineering (ICDE) (2010)
Long Beach, CA, USA
Mar. 1, 2010 to Mar. 6, 2010
ISBN: 978-1-4244-5445-7
pp: 377-380
Xifeng Yan , University of California at Santa Barbara, USA
Jiawei Han , University of Illinois at Urbana-Champaign, USA
Feida Zhu , Singapore Management University, Singapore
Bin He , IBM Almaden Research Center, USA
ABSTRACT
Searching and mining large graphs today is critical to a variety of application domains, ranging from personalized recommendation in social networks, to searches for functional associations in biological pathways. In these domains, there is a need to perform aggregation operations on large-scale networks. Unfortunately the existing implementation of aggregation operations on relational databases does not guarantee superior performance in network space, especially when it involves edge traversals and joins of gigantic tables. In this paper, we investigate the neighborhood aggregation queries: Find nodes that have top-k highest aggregate values over their h-hop neighbors. While these basic queries are common in a wide range of search and recommendation tasks, surprisingly they have not been studied systematically. We developed a Local Neighborhood Aggregation framework, called LONA, to answer them efficiently. LONA exploits two properties unique in network space: First, the aggregate value for the neighboring nodes should be similar in most cases; Second, given the distribution of attribute values, it is possible to estimate the upper-bound value of aggregates. These two properties inspire the development of novel pruning techniques, forward pruning using differential index and backward pruning using partial distribution. Empirical results show that LONA could outperform the baseline algorithm up to 10 times in real-life large networks.
INDEX TERMS
CITATION
Xifeng Yan, Jiawei Han, Feida Zhu, Bin He, "Top-K aggregation queries over large networks", 2013 IEEE 29th International Conference on Data Engineering (ICDE), vol. 00, no. , pp. 377-380, 2010, doi:10.1109/ICDE.2010.5447863
108 ms
(Ver 3.3 (11022016))