Journal of Software:2020.31(12):3968-3980

(南京理工大学 计算机科学与工程学院, 江苏 南京 210094;齐鲁工业大学 计算机科学与技术学院, 山东 济南 250353)
Image Restoration Based on Cascading Dense Network in Contourlet Transform Domain
LIU Yu-Nan,ZHANG Shan-Shan,WANG Chun-Peng,LI Guang-Yu,YANG Jian
(School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China;School of Computer Science and Technology, Qilu University of Technology, Ji'nan 250353, China)
Chart / table
Similar Articles
Article :Browse 1128   Download 978
Received:January 10, 2019    
> 中文摘要: 近年来,卷积神经网络凭借极强的学习能力,在图像复原任务上实现了比传统学习方法更令人满意的结果.但是,由于丢失了重要的纹理细节,这些基于卷积神经网络的方法普遍存在着复原图像过度平滑的缺点.为解决该问题,提出一种基于级联密集型卷积神经网络的轮廓波域图像复原方法,可以应用于单幅图像去噪、超分辨率及JPEG解压缩这3个经典图像复原任务.首先,构建了一种紧凑的级联密集型网络结构,不但可以充分挖掘和利用不同层次的图像特征,而且解决了由于网络加深带来的长期依赖问题.接着,引入可以稀疏表示图像重要特征的轮廓波变换,分别将低质量图像和重建图像对应的轮廓波子带作为网络的输入和输出,更加有效地恢复出逼真的结构和纹理细节.在标准测试集的实验表明:提出的方法在3个图像复原任务上达到了当前最优的性能,不但获得了更高的峰值信噪比和结构相似度,而且在主观的重建图像中包含了更加真实的纹理细节.
Abstract:In recent years, due to the powerful learning ability, convolutional neural networks (CNN) have achieved more satisfactory results than conventional learning methods in image restoration tasks. However, these CNN-based methods generally have the disadvantage of producing over-smoothed restored image due to the fact that losing important textural details. In order to solve this problem, this study proposes an image restoration method based on cascaded dense CNN (CDCNN) in contourlet transform, which can be used for three classical image restoration tasks, namely, single image denoising, super resolution, and JPEG decompression. First, this study constructs a compact cascading dense network structure, which not only fully exploits and utilizes the different hierarchical features of images, but also solves the problem of the long-term dependency problem as growing the network depth. Next, this study introduces the contourlet transform into CDCNN, which can sparsely represent the important image features. Here, the contourlet subbands of low-quality image and corresponding restored image are used as the input and output of the network respectively, which can recover realistic structure and texture details more effectively. Comprehensive experiments on the standard benchmarks show that the unanimous superiority of the proposed method on all three tasks over the state-of-the-art methods. The proposed method not only obtains higher peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM), but also contains more realistic textural details in the subjective reconstruct images.
文章编号:     中图分类号:TP391    文献标志码:
基金项目:国家自然科学基金(61702262,61861136011,61802212,U1713208);长江学者计划;江苏省自然科学基金(BK2018 1299);中央高校基本科研专项基金(30918011322);中国科学技术协会青年人才托举工程(2018QNRC001);并行与分布式处理实验室科学技术开放基金(WDZC20195500106) 国家自然科学基金(61702262,61861136011,61802212,U1713208);长江学者计划;江苏省自然科学基金(BK2018 1299);中央高校基本科研专项基金(30918011322);中国科学技术协会青年人才托举工程(2018QNRC001);并行与分布式处理实验室科学技术开放基金(WDZC20195500106)
Foundation items:National Natural Science Foundation of China (61702262, 61861136011, 61802212, U1713208); Program for Changjiang Scholars; Natural Science Foundation of Jiangsu Province (BK20181299); Fundamental Research Founds for the Central Universities (30918011322); Young Elite Scientists Sponsorship Program by CAST (2018QNRC001); Science and Technology on Parallel and Distributed Processing Laboratory (PDL) Open Fund (WDZC20195500106)
Reference text:


LIU Yu-Nan,ZHANG Shan-Shan,WANG Chun-Peng,LI Guang-Yu,YANG Jian.Image Restoration Based on Cascading Dense Network in Contourlet Transform Domain.Journal of Software,2020,31(12):3968-3980