| 本文已被：浏览 3967次 下载 6281次 |
码上扫一扫！ |
|
|
| 基于3D卷积神经网络的无参考视频质量评价 |
|
王春峰1, 苏荔1,2, 张维刚1,3, 黄庆明1,2
|
|
1.中国科学院大学 数据挖掘与知识管理重点实验室, 北京 100049;2.中国科学院 计算技术研究所 智能信息处理重点实验室, 北京 100190;3.哈尔滨工业大学(威海) 计算机与科学与技术学院, 山东 威海 264209
|
|
| 摘要: |
| 无参考视频质量评价（NR-VQA)在无法获得原始高质量视频参照的前提下，对失真视频的视觉质量进行定量度量.常规NR-VQA方法通常针对特定失真类型设计，或者与人的主观感受存在偏差.首次将3D深度卷积神经网络（3D-CNN)引入到了视频质量评价中，提出了一种基于3D-CNN的无参考视频质量评价方法，可以适用于非特定失真类型的NR-VQA.首先，通过3D块来有效学习和表征视频内容的时空特征.其次，对常规的3D卷积网络模型进行改进，使其适用于视频质量评价的任务.实验结果表明，所提出的方法在多种失真类型和多个测试指标上，与人的主观感知一致性较高.作为无参考视频质量评价方法，其性能与许多全参考评价方法具有可比性，同时比主流的NR-VQA方法具有更快的运行速度，这使得所提模型在实际中具有更好的应用前景. |
| 关键词: 视频质量评价 3D 深度卷积神经网络 无参考 全参考 |
| DOI： |
| 分类号: |
| 基金项目:国家自然科学基金（61025011，61332016，61472389)；国家重点基础研究发展计划（973)（2015CB351802) |
|
| No Reference Video Quality Assessment Based on 3D Convolutional Neural Network |
|
WANG Chun-Feng1, SU Li1,2, ZHANG Wei-Gang1,3, HUANG Qing-Ming1,2
|
|
1.Key Laboratory on Big Data Mining and Knowledge Management, University of Chinese Academy of Sciences, Beijing 100049, China;2.Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, The Chinese Academy of Sciences, Beijing 100190, China;3.Institute of Computer Science and Technology, Harbin Institute of Technology(Weihai), Weihai 264209, China
|
| Abstract: |
| No reference video quality assessment (NR-VQA) measures distorted videos quantitatively without the reference of original high quality videos. Conventional NR-VQA methods are generally designed for specific types of distortions, or not consistent with human's perception. This paper innovatively introduces 3D deep convolutional neural network (3D-CNN) into VQA and proposes a 3D-CNN based NR-VQA method, which is universal for non-specific types of distortions. First, the proposed method utilizes 3D patches to learn spatio-temporal features that represent video content effectively. Second, the original 3D-CNN model is modified which is used to classify videos to make it adapt to VQA task. Experiments demonstrate that the proposed method is highly consistent with human's perception across numerous distortions and metrics. Compared with other state-of-the-art no-reference VQA methods, the proposed method runs much faster while keeping the similar performance. As a no-reference VQA method, it is even comparable with many of the state-of-the-art full-reference VQA methods, which provides the proposed method with better application prospects. |
| Key words: video quality assessment 3D convolutional neural network no reference full reference |
