2012 IEEE 27th Conference on Computational Complexity (2006)

Prague, Czech Republic

July 16, 2006 to July 20, 2006

ISSN: 1093-0159

ISBN: 0-7695-2596-2

pp: 213-225

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/CCC.2006.25

Ryan O' Donnell , Microsoft Research, USA

Rocco A. Servedio , Columbia University, USA

ABSTRACT

We give an algorithm that learns any monotone Boolean function f : {-|1, 1}^n \to? {-1, 1} to any constant accuracy, under the uniform distribution, in time polynomial in n and in the decision tree size of f. This is the first algorithm that can learn arbitrary monotone Boolean functions to high accuracy, using random examples only, in time polynomial in a reasonable measure of the complexity of f. A key ingredient of the result is a new bound showing that the average sensitivity of any monotone function computed by a decision tree of size s must be at most \sqrt{log s}. This bound has already proved to be of independent utility in the study of decision tree complexity [27]. <p>We generalize the basic inequality and learning result described above in various ways; specifically, to partition size (a stronger complexity measure than decision tree size), p-biased measures over the Boolean cube (rather than just the uniform distribution), and real-valued (rather than just Boolean-valued) functions.</p>

INDEX TERMS

null

CITATION

Ryan O' Donnell,
Rocco A. Servedio,
"Learning Monotone Decision Trees in Polynomial Time",

*2012 IEEE 27th Conference on Computational Complexity*, vol. 00, no. , pp. 213-225, 2006, doi:10.1109/CCC.2006.25