The Community for Technology Leaders
Web Intelligence, IEEE / WIC / ACM International Conference on (2005)
Compi?gne University of Technology, France
Sept. 19, 2005 to Sept. 22, 2005
ISBN: 0-7695-2415-X
pp: 200-206
Leonardo Rigutini , Università di Siena
Marco Maggini , Università di Siena
<p>Document clustering is a very hard task in Automatic Text Processing since it requires to extract regular patterns from a document collection without a priori knowledge on the category structure. This task can be difficult also for humans because many different but valid partitions may exist for the same collection. Moreover, the lack of information about categories makes it difficult to apply effective feature selection techniques to reduce the noise in the representation of texts. Despite these intrinsic difficulties, text clustering is an important task for Web search applications in which huge collections or quite long query result lists must be automatically organized.</p> <p>Semi-supervised clustering lies in between automatic categorization and auto-organization. It is assumed that the supervisor is not required to specify a set of classes, but only to provide a set of texts grouped by the criteria to be used to organize the collection. In this paper we present a novel algorithm for clustering text documents which exploits the EM algorithm together with a feature selection technique based on Information Gain. The experimental results show that only very few documents are needed to initialize the clusters and that the algorithm is able to properly extract the regularities hidden in a huge unlabeled collection.</p>
Semi-supervised Document Clustering, EM, Information Gain

L. Rigutini and M. Maggini, "A Semi-Supervised Document Clustering Algorithm Based on EM," Proceedings. The 2005 IEEE/WIC/ACM International Conference on Web Intelligence(WI), Compiegne, France, 2005, pp. 200-206.
93 ms
(Ver 3.3 (11022016))