2005 IEEE/WIC/ACM International Conference on Web Intelligence (WI'05)
Improving Web Clustering by Cluster Selection
Compi?gne University of Technology, France
September 19-September 22
ISBN: 0-7695-2415-X
Web page clustering is a technology that puts semantically related web pages into groups and is useful for categorizing, organizing, and refining search results. When clustering using only textual information, Suffix Tree Clustering (STC) outperforms other clustering algorithms by making use of phrases and allowing clusters to overlap. One problem of STC and other similar algorithms is how to select a small set of clusters to display to the user from a very large set of generated clusters. The cluster selection method used in STC is flawed in that it does not handle overlapping clusters appropriately. This paper introduces a new cluster scoring function and a new cluster selection algorithm to overcome the problems with overlapping clusters, which are combined with STC to make a new clustering algorithm ESTC. This paper?s experiments show that ESTC significantly outperforms STC and that even with less data ESTC performs similarly to a commercial clustering search engine.
Index Terms:
web clustering, cluster selection
Citation:
Daniel Crabtree, Xiaoying Gao, Peter Andreae, "Improving Web Clustering by Cluster Selection," wi, pp.172-178, 2005 IEEE/WIC/ACM International Conference on Web Intelligence (WI'05), 2005