Efficient Federated Learning with Privacy-preserving Grouping and Generation
Author:
Affiliation:

Clc Number:

TP311

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Federated learning is currently the most advanced technology in secure multi-party machine learning and has attracted significant attention for its ability to enable collaborative model training across multiple nodes without requiring data to leave local devices. However, in real-world scenarios, client data are often non-independent and identically distributed (Non-IID), which significantly degrades the performance of the global model. Current mainstream methods primarily focus on correcting model parameter biases during training, but their effectiveness diminishes as data distribution becomes more extreme. Another category of methods aims to correct data distribution biases before local training, but this approach poses privacy risks. This study proposes a framework that adheres to strict federated learning privacy protection requirements and utilizes techniques such as differential privacy and secure multi-party computation. Assuming that client data distributions remain black boxes, the most beneficial labels for improving global model performance are selected. High-quality synthetic data are generated for these labels and distributed to clients, thus making the local data distribution closer to IID and significantly enhancing the performance of the global model. Specifically, a privacy-preserving algorithm is first designed to capture the distribution of labels across clients, and clients are grouped according to these label distribution characteristics. Then, the most worthwhile labels for generation are selected, and within the corresponding groups, clients are coordinated to collaboratively train high-quality global generative models, which are stored on the server. During the training phase of the task model, based on label distribution characteristics, samples are selectively synthesized using these generative models and distributed to clients, resulting in a more uniform local data distribution. This process reduces local model disparities and yields a high-quality global model after aggregation. Experimental results demonstrate that the proposed method can effectively improve the accuracy of the global model on the test set and reduce the number of federated learning communication rounds required before convergence. Its effectiveness surpasses that of baseline methods and has been validated on different datasets.

    Reference
    Related
    Cited by
Get Citation

周众泽,张俊,寿黎但,陈珂,陈刚.基于隐私保护分组生成的高效联邦学习.软件学报,,():1-23

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:May 10,2024
  • Revised:March 13,2025
  • Adopted:
  • Online: May 20,2026
  • Published:
You are the firstVisitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063