| 摘要: |
| 联邦学习作为解决数据孤岛问题的有效方法,在服务器计算全部梯度的过程中,由于服务器的惰性和自利性会存在全局梯度不正确计算问题,因此需要验证全局梯度的完整性.现有的基于密码算法的方案验证开销过大.针对这些问题,提出一种理性与可验证的联邦学习框架.首先,结合博弈论,设计囚徒合约与背叛合约迫使服务器诚实.其次,所提方案使用基于复制的验证方案实现全局梯度的完整性验证,且支持客户端离线.最后,经分析证明所提方案的正确性,并经实验表明,该方案与已有的验证算法相比,客户端的计算开销降为0,一次迭代的通信轮数由原来的3轮优化到2轮,且训练开销与客户端的离线率成反比. |
| 关键词: 联邦学习 博弈论 囚徒合约 背叛合约 数据完整性 |
| DOI：10.13328/j.cnki.jos.006819 |
| 分类号:TP18 |
| 基金项目:国家自然科学基金(61662009,61772008);贵州省科技重大专项(20183001);国家自然科学基金联合基金(U1836205);贵州省科技计划(黔科合基础[2019]1098);贵州省高层次创新型人才项目(黔科合平台人才[2020]6008);贵阳市科技计划(筑科合[2021]1-5) |
|
| Rational and Verifiable Federated Learning Framework |
|
WU Shi-Hong1,2, TIAN You-Liang1,2,3
|
|
1.State Key Laboratory of Public Big Data(Guizhou University), Guiyang 550025, China;2.College of Computer Science and Technology, Guizhou University, Guiyang 550025, China;3.Institute of Cryptography & Date Security, Guizhou University, Guiyang 550025, China
|
| Abstract: |
| Federated learning is an effective method to solve the problem of data silos. When the server calculates all gradients, incorrect calculation of global gradients exists due to the inertia and self-interest of the server, so it is necessary to verify the integrity of global gradients. The existing schemes based on cryptographic algorithms are overspending on verification. To solve these problems, this study proposes a rational and verifiable federated learning framework. Firstly, according to game theory, the prisoner contract and betrayal contract are designed to force the server to be honest. Secondly, the scheme uses a replication-based verification scheme to verify the integrity of the global gradient and supports the offline client side. Finally, the analysis proves the correctness of the scheme, and the experiments show that compared with the existing verification algorithms, the proposed scheme reduces the computing overhead of the client side to zero, the number of communication rounds in one iteration is optimized from three to two, and the training overhead is inversely proportional to the offline rate of the client side |
| Key words: federated learning game theory prisoner’s contract betrayal contract data integrity |
