基于像素级-块级伪影协同建模的AI生成图像模型溯源
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP18

基金项目:

国家自然科学基金区域创新发展联合基金重点项目(U22A2030); 国家自然科学基金青年基金(62402062); 国家自然科学基金面上项目(62371301); 国家重点研发计划(2024YFF0618800); 湖南省自然科学基金青年基金(2025JJ60415); 湖南省自然科学基金杰出青年基金(2024JJ2025); 湖南省重点研发计划(2024AQ2027, 2025AQ2022); 湖南省重大科技攻关(2025QK2008); 湖南省教育厅优秀青年项目(25B0221); 岳麓山工业创新中心项目(2025YCII0222)


Collaborative Pixel-block Artifact Modeling for AI-generated Image model source Attribution
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    随着扩散模型和生成对抗网络的快速发展, AI 生成图像在内容创作中的应用日益广泛, 同时也对内容可信性与生成来源溯源提出新的挑战. 相较于仅区分图像真伪, 准确判定生成图像的来源模型具有更高的实际应用价值, 例如在生成内容平台监管、恶意伪造内容追溯以及生成模型责任追踪等场景中, 能够为内容来源识别与可信治理提供重要技术支撑. 不同生成模型在合成过程中往往会在像素层面留下细粒度高频伪影, 同时在结构与全局层面形成具有模型特征的生成模式一致性差异. 这种跨尺度的伪影现象表明, 现有的仅依赖单一尺度或单一语义层面的特征表示方法, 难以同时刻画细粒度伪影与全局生成风格差异, 从而限制在复杂多模型场景下归属性能. 针对上述不足, 提出一种像素到块级伪影协同建模(collaborative pixel-block artifact modeling, CPB-AM)框架, 用于AI生成图像的模型溯源任务. 该方法采用双分支结构对不同层级的生成伪影进行协同建模, 像素级分支通过高频增强操作提取局部伪造痕迹, 并学习与生成域相关的细粒度伪影特征; 块级分支将图像划分为局部块, 并通过频率感知的注意力聚合机制对块间的相关性进行建模. 该注意力机制通过对低频平滑成分进行自适应聚合, 显式分离结构一致性表示与残差成分, 从而更有效地刻画生成模型在空间结构与整体风格层面的差异. 同时, 在跨尺度融合方面, 设计跨分支注意力引导融合模块, 是一种引导式特征融合机制, 通过构建像素级伪影特征对块级表示的调制权重, 实现细粒度残差信息对结构建模过程的引导与约束, 从而增强跨尺度伪影信息的互补性. 在包含真实图像与多种生成模型的数据集上的实验结果表明, 所提方法在闭集生成模型溯源任务中能够取得优于现有方法的分类性能; 在未见生成模型参与测试的开集实验设置下, 该方法在未知模型拒识与归属判别方面同样表现出较强的鲁棒性. 实验结果验证了像素到块级伪影协同建模策略在提升生成模型溯源准确性与开放场景适应能力方面的有效性.

    Abstract:

    With the rapid development of diffusion models and generative adversarial networks, AI-generated images are increasingly used in content creation, while also posing new challenges to content trustworthiness and source attribution. Compared with merely distinguishing authentic images from fake ones, accurately identifying the source generative model of generated images has greater practical significance. For instance, this capability can provide important technical support for content source identification and trustworthy governance in scenarios such as generated content platform regulation, tracing of maliciously forged content, and responsibility tracking of generative models. During the synthesis process, different generative models often leave fine-grained high-frequency artifacts at the pixel level, while also producing model-specific differences in generative pattern consistency at the structural and global levels. This cross-scale artifact phenomenon indicates that existing methods relying solely on single-scale or single-semantic-level feature representations are insufficient for simultaneously capturing fine-grained artifacts and global generative style differences, thus limiting attribution performance in complex multi-model scenarios. To address these issues, this study proposes a collaborative pixel-block artifact modeling framework (CPB-AM) for AI-generated image model source attribution. The proposed method adopts a dual-branch architecture to jointly model generative artifacts at different levels. The pixel-level branch extracts local forgery traces through high-frequency enhancement operations and learns fine-grained artifact features associated with the generative domain. The block-level branch partitions the image into local blocks and models inter-block correlations through a frequency-aware attention aggregation mechanism. This attention mechanism adaptively aggregates low-frequency smooth components and explicitly separates structural consistency representations from residual components, enabling more effective characterization of differences among generative models in terms of spatial structure and overall style. Furthermore, for cross-scale fusion, a cross-branch attention-guided fusion module is designed as a guided feature fusion mechanism. By constructing modulation weights from pixel-level artifact features for block-level representations, the module enables fine-grained residual information to guide and constrain the structural modeling process, thus enhancing the complementarity of cross-scale artifact information. Experimental results on datasets containing real images and multiple generative models demonstrate that the proposed method achieves superior classification performance compared with existing approaches in closed-set generative model source attribution tasks. Under open-set experimental settings involving unseen generative models, the proposed method also exhibits strong robustness in both unknown model rejection and attribution discrimination. These results verify the effectiveness of the collaborative pixel-block artifact modeling strategy in improving generative model source attribution accuracy and adaptability to open scenarios.

    参考文献
    相似文献
    引证文献
引用本文

范宇祺,陈嘉欣,廖鑫,陈昌盛,章登勇.基于像素级-块级伪影协同建模的AI生成图像模型溯源.软件学报,,():1-21

复制
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-03-25
  • 最后修改日期:2026-04-16
  • 录用日期:
  • 在线发布日期: 2026-07-22
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号