Issue No. 08 - August (2004 vol. 16)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TKDE.2004.32
Chris Clifton , IEEE
Robert Cooley , IEEE
<p><b>Abstract</b>—TopCat (Topic Categories) is a technique for identifying topics that recur in articles in a text corpus. Natural language processing techniques are used to identify key entities in individual articles, allowing us to represent an article as a set of items. This allows us to view the problem in a database/data mining context: Identifying related groups of items. This paper presents a novel method for identifying related items based on traditional data mining techniques. Frequent itemsets are generated from the groups of items, followed by clusters formed with a hypergraph partitioning scheme. We present an evaluation against a manually categorized ground truth news corpus; it shows this technique is effective in identifying topics in collections of news articles.</p>
Topic detection, data mining, clustering.
Chris Clifton, Robert Cooley, Jason Rennie, "TopCat: Data Mining for Topic Identification in a Text Corpus", IEEE Transactions on Knowledge & Data Engineering, vol. 16, no. , pp. 949-964, August 2004, doi:10.1109/TKDE.2004.32