AIセキュリティポータル K Program
AAA: an Adaptive Mechanism for Locally Differential Private Mean Estimation
Share
Abstract
Local differential privacy (LDP) is a strong privacy standard that has been adopted by popular software systems. The main idea is that each individual perturbs their own data locally, and only submits the resulting noisy version to a data aggregator. Although much effort has been devoted to computing various types of aggregates and building machine learning applications under LDP, research on fundamental perturbation mechanisms has not achieved significant improvement in recent years. Towards a more refined result utility, existing works mainly focus on improving the worst-case guarantee. However, this approach does not necessarily promise a better average performance given the fact that the data in practice obey a certain distribution, which is not known beforehand. In this paper, we propose the advanced adaptive additive (AAA) mechanism, which is a distribution-aware approach that addresses the average utility and tackles the classical mean estimation problem. AAA is carried out in a two-step approach: first, as the global data distribution is not available beforehand, the data aggregator selects a random subset of individuals to compute a (noisy) quantized data descriptor; then, the data aggregator collects data from the remaining individuals, which are perturbed in a distribution-aware fashion. The perturbation involved in the latter step is obtained by solving an optimization problem, which is formulated with the data descriptor obtained in the former step and the desired properties of task-determined utilities. We provide rigorous privacy proofs, utility analyses, and extensive experiments comparing AAA with state-of-the-art mechanisms. The evaluation results demonstrate that the AAA mechanism consistently outperforms existing solutions with a clear margin in terms of result utility, on a wide range of privacy constraints and real-world and synthetic datasets.
Deep learning with differential privacy
Martin Abadi, Andy Chu, Ian Goodfellow, H Brendan McMahan, Ilya Mironov, Kunal Talwar, Li Zhang
Published: 2016
Hadamard Response: Estimating Distributions Privately, Efficiently, and with Little Communication
Jayadev Acharya, Ziteng Sun, Huanyu Zhang
Published: 2018
Cactus mechanisms: Optimal differential privacy mechanisms in the large-composition regime
Wael Alghamdi, Shahab Asoodeh, Flavio P Calmon, Oliver Kosut, Lalitha Sankar, Fei Wei
Published: 2022
Practical Locally Private Heavy Hitters
Raef Bassily, Kobbi Nissim, Uri Stemmer, Abhradeep Guha Thakurta
Published: 2017
Local, Private, Efficient Protocols for Succinct Histograms
Raef Bassily, Adam Smith
Published: 2015
Prochlo: Strong privacy for analytics in the crowd
Andrea Bittau, Ulfar Erlingsson, Petros Maniatis, Ilya Mironov, Ananth Raghunathan, David Lie, Mitch Rudominer, Ushasree Kode, Julien Tinnes, Bernhard Seefeld
Published: 2017
Optimal geo-indistinguishable mechanisms for location privacy
Nicolás E Bordenabe, Konstantinos Chatzikokolakis, Catuscia Palamidessi
Published: 2014
Heavy Hitters and the Structure of Local Privacy
Mark Bun, Jelani Nelson, Uri Stemmer
Published: 2019
AAA: an Adaptive Mechanism for Locally Differential Private Mean Estimation
Fei Wei, Ergute Bao, Xiaokui Xiao, Yin Yang, Bolin Ding
Published: 2024.4.2
A Course in Probability
N.A. Weiss, P.T. Holmes, M. Hardy
Published: 2006
Share