A Federated Learning Framework Based on Differentially Private Continuous Data Release

Jianping Cai, Ximeng Liu, Qingqing Ye, Yang Liu, Yuyang Wang

Research output: Journal article publicationJournal articleAcademic researchpeer-review

Abstract

Federated learning (FL) provides a learning framework without participants sharing local raw data, but individual privacy is still at risk of disclosure through attacking the trained models. Due to the strong privacy guarantee, differential privacy (DP) is widely applied to FL to avoid privacy leakage. Traditional private learning adds noise directly to the gradients. The continuous accumulated noise on parameter models severely impairs learning effectiveness. To solve this problem, we introduce the idea of differentially private continuous data release (DPCR) into FL and propose an FL framework based on DPCR (FL-DPCR). Meanwhile, our proposed Equivalent Aggregation Theorem demonstrates that DPCR effectively reduces the overall error added to parameter models and improves FL&#x0027;s accuracy. To improve FL-DPCR&#x0027;s learning effectiveness, we introduce Matrix Mechanism to construct a release strategy and design a binary-indexed-tree (BIT) based DPCR model for Gaussian mechanism (BCRG). By solving a complex nonlinear programming problem with negative exponents, BCRG achieves optimal release accuracy efficiently. Besides, we exploit the residual privacy budget to boost the accuracy further and propose an advanced BCRG version (ABCRG). Our experiments show that, compared to traditional FL with DP, our achievements improve the accuracy with gains ranging from <inline-formula><tex-math notation="LaTeX">$3.4\%$</tex-math></inline-formula> on FMNIST to <inline-formula><tex-math notation="LaTeX">$65.7\%$</tex-math></inline-formula> on PAMAP2.

Original languageEnglish
Article number10426793
Pages (from-to)1-16
Number of pages16
JournalIEEE Transactions on Dependable and Secure Computing
DOIs
Publication statusPublished - Feb 2024

Keywords

  • Artificial intelligence
  • Binary Indexed Tree
  • Biomedical imaging
  • Computational modeling
  • Continuous Data Release
  • Data models
  • Differential privacy
  • Differential Privacy
  • Federated learning
  • Matrix Mechanism
  • Privacy
  • Security

ASJC Scopus subject areas

  • General Computer Science
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'A Federated Learning Framework Based on Differentially Private Continuous Data Release'. Together they form a unique fingerprint.

Cite this