面向概念漂移的在线神经网络深度自适应调整方法
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP18

基金项目:

国家重点研发计划(2022YFB3304100)


Adaptive Depth Adjustment Scheme for Online Neural Networks Under Concept Drift
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    非平稳场景下深度神经网络(deep neural network, DNN)模型的适应性是当前人工智能领域面临的一个重要挑战. 尤其在发生概念漂移的场景, 预设架构参数的模型将难以适应演化的数据分布. DNN现有深度调整方法缺乏对深度拓展的有效性的评估, 忽视了深度调整过程中网络权重参数和深度的协同. 为此, 提出自适应在线深度神经网络(adaptive online deep neural network, AODNN). AODNN根据网络的损失变化趋势、分类器权重以及互信息变化组合分析对深度增长的有效性做出判断, 实现深度自适应增长; 并通过参数更新优化选择合适的中间分类器参与反向传播, 减少深层中间分类器对浅层分类器的干扰并加速收敛. AODNN在多个包含概念漂移的真实和合成数据集上与当前最先进方法开展对比实验, 实验结果验证了AODNN深度自适应增长和参数更新优化策略的有效性, 能够有效捕捉数据分布变化并抑制概念漂移的影响. 在关键性能指标的比较中, AODNN展现出显著优势, 在累计准确率上显著优于HBP、ANSN和EODL, 在F1分数上显著优于ATNN、ANSN和EODL, 在MCC上显著优于ANSN和EODL. 此外, 在模型收敛速度等方面, AODNN也超越了当前最先进方法.

    Abstract:

    The adaptability of deep neural network (DNN) models in non-stationary scenarios remains a significant challenge in the field of artificial intelligence. In particular, when concept drift occurs, models with predefined architectural parameters struggle to adapt to evolving data distributions. Existing depth adjustment methods for DNNs do not adequately evaluate the validity of depth expansion and overlook the synergy between network weights and depth during the adjustment process. To address this issue, this study proposes an adaptive online deep neural network (AODNN). AODNN assesses the effectiveness of depth expansion by jointly analyzing the network’s loss trends, classifier weights, and changes in mutual information, thus enabling adaptive depth growth. In addition, it employs parameter update optimization to select intermediate classifiers for participation in backpropagation, reducing interference from deeper intermediate classifiers to shallower ones and accelerating convergence. Comparative experiments are conducted between AODNN and state-of-the-art methods on multiple real-world and synthetic datasets containing concept drift. The experimental results validate the effectiveness of AODNN’s adaptive depth growth and parameter update optimization strategies, demonstrating its capability to effectively capture changes in data distribution and mitigate the impact of concept drift. Across key performance metrics, AODNN demonstrates significant advantages, notably outperforming HBP, ANSN, and EODL in cumulative accuracy, surpassing ATNN, ANSN, and EODL in F1-score, and achieving significantly better MCC compared to ANSN and EODL. Furthermore, AODNN surpasses current state-of-the-art methods in aspects of model convergence speed.

    参考文献
    相似文献
    引证文献
引用本文

邹迪,周学文,范玉雷,高楠,喻坚,杨良怀.面向概念漂移的在线神经网络深度自适应调整方法.软件学报,,():1-19

复制
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-08-18
  • 最后修改日期:2025-09-27
  • 录用日期:
  • 在线发布日期: 2026-05-20
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号