The Community for Technology Leaders
Green Image
Issue No. 10 - October (2008 vol. 20)
ISSN: 1041-4347
pp: 1348-1362
Taneli Mielikäinen , Nokia Research Center Palo Alto, Palo Alto
Heikki Mannila , University of Helsinki and Helsinki University of Technology, Helsinki
Gautam Das , University of Texas at Arlington, Arlington
Aristides Gionis , Yahoo, Barcelona
Pauli Miettinen , University of Helsinki, University of Helsinki
ABSTRACT
Matrix decomposition methods represent a data matrix as a product of two factor matrices: one containing basis vectors that represent meaningful concepts in the data, and another describing how the observed data can be expressed as combinations of the basis vectors. Decomposition methods have been studied extensively, but many methods return real-valued matrices. Interpreting real-valued factor matrices is hard if the original data is Boolean. In this paper, we describe a matrix decomposition formulation for Boolean data, the Discrete Basis Problem. The problem seeks for a Boolean decomposition of a binary matrix, thus allowing the user to easily interpret the basis vectors. We also describe a variation of the problem, the Discrete Basis Partitioning Problem. We show that both problems are NP-hard. For the Discrete Basis Problem, we give a simple greedy algorithm for solving it; for the Discrete Basis Partitioning Problem we show how it can be solved using existing methods. We present experimental results for the greedy algorithm and compare it against other, well known methods. Our algorithm gives intuitive basis vectors, but its reconstruction error is usually larger than with the real-valued methods. We discuss about the reasons for this behavior.
INDEX TERMS
Mining methods and algorithms, Clustering, classification, and association rules, Text mining
CITATION
Taneli Mielikäinen, Heikki Mannila, Gautam Das, Aristides Gionis, Pauli Miettinen, "The Discrete Basis Problem", IEEE Transactions on Knowledge & Data Engineering, vol. 20, no. , pp. 1348-1362, October 2008, doi:10.1109/TKDE.2008.53
109 ms
(Ver )