基于特征压缩与特征融合的高效分裂联邦学习框架
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP18

基金项目:

国家自然科学基金(624B2136, 62472401, 62132019, 62502487); 中央高校基本科研业务费专项资金(WK2150250044)


Efficient Split Federated Learning Framework with Feature Compression and Feature Fusion
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为了提高人工智能应用的性能, 大规模模型因其优秀的广义能力而受到越来越多的关注. 然而, 大规模模型的训练和传输会给资源有限的边缘节点带来巨大的计算和通信负担, 并且完整模型的交换可能会侵犯模型的隐私. 为了减轻节点的负担并保护模型的隐私, 集成数据并行和模型并行的分裂联邦学习被提出. 然而, 除了资源有限的挑战, 分裂联邦学习在边缘计算系统中还面临着另外两个关键的挑战, 即统计异构性和系统异构性. 为了解决这些挑战, 结合分裂联邦学习的特性, 提出一种新的基于特征压缩与特征融合的高效分裂联邦学习框架SplitCP. 具体地说, 特征压缩的目的是降低节点的通信资源消耗, 并通过为异构节点分配合适的压缩比以提高训练效率. 而特征融合的目的是将节点的特征融合成一个混合特征序列, 近似等同于独立同分布数据的特征, 克服统计异构性挑战来提高模型的精度. 此外, SplitCP通过分析自适应特征压缩与特征融合的耦合关系, 探索如何联合优化以提升分裂联邦学习的模型训练性能. 在使用80台NVIDIA Jetson边缘设备搭建的物理平台上进行广泛的实验, 实验结果表明, 与基线相比, SplitCP可以将最终模型精度提高6.46%–26.15%, 同时实现训练加速约1.31–3.51倍.

    Abstract:

    To improve the performance of AI applications, large-scale models have received increasing attention due to their excellent generalization ability. However, the training and transmission of large-scale models impose significant computational and communication burdens on resource-constrained edge nodes, and the exchange of complete models may violate model privacy. To reduce the burden on nodes and protect model privacy, split federated learning (SFL), which integrates data parallelism and model parallelism, is proposed. However, in addition to the challenge of resource limitations, SFL also faces two other critical challenges in edge computing (EC) systems, i.e., statistical heterogeneity and system heterogeneity. To address these challenges, this study proposes a novel, efficient SFL framework based on feature compression and feature fusion, termed SplitCP, by incorporating the characteristics of SFL. Specifically, feature compression aims to reduce the communication resource consumption of nodes and improve training efficiency by assigning appropriate compression ratios to heterogeneous nodes. Feature fusion aims to merge the features of nodes into a mixed feature sequence, which is approximately equivalent to the features of independent and identically distributed (IID) data, thus overcoming the challenge of statistical heterogeneity and improving model accuracy. Moreover, by analyzing the coupling relationship between adaptive feature compression and feature fusion, SplitCP explores how to jointly optimize them to improve the model training performance of SFL. Extensive experiments are conducted on a physical platform built with 80 NVIDIA Jetson edge devices, and the experimental results show that, compared with the baselines, SplitCP can improve the final model accuracy by 6.46% to 26.15% while achieving training speedups of approximately 1.31× to 3.51×.

    参考文献
    相似文献
    引证文献
引用本文

廖云铭,马欣莹,许杨,徐宏力,黄刘生.基于特征压缩与特征融合的高效分裂联邦学习框架.软件学报,,():1-19

复制
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-11-17
  • 最后修改日期:2026-03-04
  • 录用日期:
  • 在线发布日期: 2026-08-26
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号