Issue No.06 - June (2010 vol.22)
Wee Keong Ng , Nanyang Technological University, Singapore
Li Wan , Nanyang Technological University, Singapore
Shuguo Han , Nanyang Technological University, Singapore
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TKDE.2009.153
Gradient descent is a widely used paradigm for solving many optimization problems. Gradient descent aims to minimize a target function in order to reach a local minimum. In machine learning or data mining, this function corresponds to a decision model that is to be discovered. In this paper, we propose a preliminary formulation of gradient descent with data privacy preservation. We present two approaches—stochastic approach and least square approach—under different assumptions. Four protocols are proposed for the two approaches incorporating various secure building blocks for both horizontally and vertically partitioned data. We conduct experiments to evaluate the scalability of the proposed secure building blocks and the accuracy and efficiency of the protocols for four different scenarios. The excremental results show that the proposed secure building blocks are reasonably scalable and the proposed protocols allow us to determine a better secure protocol for the applications for each scenario.
Privacy-preserving data mining, gradient-descent method, secure multiparty computation, stochastic approach, least square approach.
Wee Keong Ng, Li Wan, Shuguo Han, "Privacy-Preserving Gradient-Descent Methods", IEEE Transactions on Knowledge & Data Engineering, vol.22, no. 6, pp. 884-899, June 2010, doi:10.1109/TKDE.2009.153