2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS) (2017)
Berkeley, California, USA
Oct. 15, 2017 to Oct. 17, 2017
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/FOCS.2017.57
A pervasive task in the differential privacy literature is to select the k items of “highest quality” out of a set of d items, where the quality of each item depends on a sensitive dataset that must be protected. Variants of this task arise naturally in fundamental problems like feature selection and hypothesis testing, and also as subroutines for many sophisticated differentially private algorithms. The standard approaches to these tasks-repeated use of the exponential mechanism or the sparse vector technique-approximately solve this problem given a dataset of n = O(√k log d) samples. We provide a tight lower bound for some very simple variants of the private selection problem. Our lower bound shows that a sample of size n = Ω(√k log d) is required even to achieve a very minimal accuracy guarantee. Our results are based on an extension of the fingerprinting method to sparse selection problems. Previously, the fingerprinting method has been used to provide tight lower bounds for answering an entire set of d queries, but often only some much smaller set of k queries are relevant. Our extension allows us to prove lower bounds that depend on both the number of relevant queries and the total number of queries.
computational complexity, data privacy, feature selection, query processing
T. Steinke and J. Ullman, "Tight Lower Bounds for Differentially Private Selection," 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS), Berkeley, California, USA, 2017, pp. 552-563.