2015 IEEE 56th Annual Symposium on Foundations of Computer Science (FOCS) (2015)

Berkeley, CA, USA

Oct. 17, 2015 to Oct. 20, 2015

ISSN: 0272-5428

ISBN: 978-1-4673-8191-8

pp: 923-942

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/FOCS.2015.61

ABSTRACT

Sub modular and fractionally sub additive (or equivalently XOS) functions play a fundamental role in combinatorial optimization, algorithmic game theory and machine learning. Motivated by learn ability of these classes of functions from random examples, we consider the question of how well such functions can be approximated by low-degree polynomials in L2 norm over the uniform distribution. This question is equivalent to understanding of the concentration of Fourier weight on low-degree coefficients, a central concept in Fourier analysis. We show that. For any sub modular function f:{0, 1}n &#x2192; [0, 1], deg l2&#x03B5;(f) = O(log(1/&#x03B5;)/&#x03B5;4/5) there is a sub modular function that requires degree &#x03A9;(1/&#x03B5;4/5}). For any XOS function f:{0, 1}n &#x2192; [0, 1], deg l2&#x03B5;(f) = O(1/&#x03B5;) and there exists an XOS function that requires degree &#x03A9;(1/&#x03B5;). This improves on previous approaches that all showed an upper bound of O(1/&#x03B5;2) for sub modular and XOS functions. The best previous lower bound was &#x03A9;(1/&#x03B5;{2/3}) for monotone sub modular functions. Our techniques reveal new structural properties of sub modular and XOS functions and the upper bounds lead to nearly optimal PAC learning algorithms for these classes of functions.

INDEX TERMS

Upper bound, Polynomials, Approximation algorithms, Approximation methods, Game theory, Machine learning algorithms, Algorithm design and analysis

CITATION

V. Feldman and J. Vondrak, "Tight Bounds on Low-Degree Spectral Concentration of Submodular and XOS Functions,"

*2015 IEEE 56th Annual Symposium on Foundations of Computer Science (FOCS)*, Berkeley, CA, USA, 2015, pp. 923-942.

doi:10.1109/FOCS.2015.61

CITATIONS