Issue No. 10 - October (2008 vol. 20)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TKDE.2008.53
Pauli Miettinen , University of Helsinki, University of Helsinki
Taneli Mielikäinen , Nokia Research Center Palo Alto, Palo Alto
Aristides Gionis , Yahoo, Barcelona
Gautam Das , University of Texas at Arlington, Arlington
Heikki Mannila , University of Helsinki and Helsinki University of Technology, Helsinki
Matrix decomposition methods represent a data matrix as a product of two factor matrices: one containing basis vectors that represent meaningful concepts in the data, and another describing how the observed data can be expressed as combinations of the basis vectors. Decomposition methods have been studied extensively, but many methods return real-valued matrices. Interpreting real-valued factor matrices is hard if the original data is Boolean. In this paper, we describe a matrix decomposition formulation for Boolean data, the Discrete Basis Problem. The problem seeks for a Boolean decomposition of a binary matrix, thus allowing the user to easily interpret the basis vectors. We also describe a variation of the problem, the Discrete Basis Partitioning Problem. We show that both problems are NP-hard. For the Discrete Basis Problem, we give a simple greedy algorithm for solving it; for the Discrete Basis Partitioning Problem we show how it can be solved using existing methods. We present experimental results for the greedy algorithm and compare it against other, well known methods. Our algorithm gives intuitive basis vectors, but its reconstruction error is usually larger than with the real-valued methods. We discuss about the reasons for this behavior.
Mining methods and algorithms, Clustering, classification, and association rules, Text mining
T. Mielikäinen, H. Mannila, G. Das, A. Gionis and P. Miettinen, "The Discrete Basis Problem," in IEEE Transactions on Knowledge & Data Engineering, vol. 20, no. , pp. 1348-1362, 2008.