Issue No. 10 - October (2008 vol. 20)

ISSN: 1041-4347

pp: 1348-1362

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TKDE.2008.53

Taneli Mielikäinen , Nokia Research Center Palo Alto, Palo Alto

Heikki Mannila , University of Helsinki and Helsinki University of Technology, Helsinki

Gautam Das , University of Texas at Arlington, Arlington

Aristides Gionis , Yahoo, Barcelona

Pauli Miettinen , University of Helsinki, University of Helsinki

ABSTRACT

Matrix decomposition methods represent a data matrix as a product of two factor matrices: one containing basis vectors that represent meaningful concepts in the data, and another describing how the observed data can be expressed as combinations of the basis vectors. Decomposition methods have been studied extensively, but many methods return real-valued matrices. Interpreting real-valued factor matrices is hard if the original data is Boolean. In this paper, we describe a matrix decomposition formulation for Boolean data, the Discrete Basis Problem. The problem seeks for a Boolean decomposition of a binary matrix, thus allowing the user to easily interpret the basis vectors. We also describe a variation of the problem, the Discrete Basis Partitioning Problem. We show that both problems are NP-hard. For the Discrete Basis Problem, we give a simple greedy algorithm for solving it; for the Discrete Basis Partitioning Problem we show how it can be solved using existing methods. We present experimental results for the greedy algorithm and compare it against other, well known methods. Our algorithm gives intuitive basis vectors, but its reconstruction error is usually larger than with the real-valued methods. We discuss about the reasons for this behavior.

INDEX TERMS

Mining methods and algorithms, Clustering, classification, and association rules, Text mining

CITATION

Taneli Mielikäinen, Heikki Mannila, Gautam Das, Aristides Gionis, Pauli Miettinen, "The Discrete Basis Problem",

*IEEE Transactions on Knowledge & Data Engineering*, vol. 20, no. , pp. 1348-1362, October 2008, doi:10.1109/TKDE.2008.53SEARCH