2015 IEEE 56th Annual Symposium on Foundations of Computer Science (FOCS) (2015)
Berkeley, CA, USA
Oct. 17, 2015 to Oct. 20, 2015
ISSN: 0272-5428
ISBN: 978-1-4673-8191-8
pp: 1049-1065
ABSTRACT
In this paper we improve upon the running time for finding a point in a convex set given a separation oracle. In particular, given a separation oracle for a convex set K &amp;#x2282; Rn that is contained in a box of radius R we show how to either compute a point in K or prove that K does not contain a ball of radius &amp;#x03B5; using an expected O(n log(nR=&amp;#x03B5;)) evaluations of the oracle and additional time O(n3 logO(1)(nR=&amp;#x03B5;)). This matches the oracle complexity and improves upon the O(n&amp;#x03C9;+1 log(nR=&amp;#x03B5;)) additional time of the previous fastest algorithm achieved over 25 years ago by Vaidya [91] for the current value of the matrix multiplication constant &amp;#x03C9; < 2:373 [98], [36] when R=&amp;#x03B5; = O(poly(n)). Using a mix of standard reductions and new techniques we show how our algorithm can be used to improve the running time for solving classic problems in continuous and combinatorial optimization. In particular we provide the following running time improvements: &amp;#x03B5; Sub modular Function Minimization: n is the size of the ground set, M is the maximum absolute value of function values and EO is the time for function evaluation. Our weakly and strongly polynomial time algorithms have a running time of O(n2 lognM EO+n3 logO(1) nM) and O(n3 log2 n EO+n4 logO(1) n), improving upon the previous best of O((n4 · EO+n5) logM) and O(n5 · EO + n6) respectively. &amp;#x03B5; Sub modular Flow: n = |V|, m = |E|, C is the maximum edge cost in absolute value and U is maximum edge capacity in absolute value. We obtain a faster weakly polynomial running time of O(n2 log nCU · EO + n3 logO(1) nCU), improving upon the previous best of O(mn5 log nU · EO) and O(n4h min {log C, log U}) from 15 years ago by a factor of Õ(n4). We also achieve faster strongly polynomial time algorithms as a consequence of our result on sub modular minimization. &amp;#x03B5; Matroid Intersection: n is the size of the ground set, r is the maximum size of independent sets, M is the maximum absolute value of element weight, Trank and Tind are the time for each rank and independence oracle query. We obtain a running time of O((nr log2 nTrank+n3 logO(1) n) lognM) and O((n2 log nTind+n3 logO(1) n) lognM), achieving the first quadratic bound on the query complexity for the independence and rank oracles. In the unweighted case, this is the first improvement since 1986 for independence oracle. &amp;#x03B5; Semi definite Programming: n is the number of constraints, m is the number of dimensions and S is the total number of non-zeros in the constraint matrices. We obtain a running time of Õ(n(n2 +m&amp;#x03C9; +S)), improving upon the previous best of Õ(n(n&amp;#x03C9; +m&amp;#x03C9; +S)) for the regime S is small.
INDEX TERMS
Ellipsoids, Optimization, Algorithm design and analysis, Complexity theory, Polynomials, Convex functions, Minimization
CITATION

Y. T. Lee, A. Sidford and S. C. Wong, "A Faster Cutting Plane Method and its Implications for Combinatorial and Convex Optimization," 2015 IEEE 56th Annual Symposium on Foundations of Computer Science (FOCS), Berkeley, CA, USA, 2015, pp. 1049-1065.
doi:10.1109/FOCS.2015.68