沈俊晖,薛丽霞,汪荣贵,等.适用于图像超分辨率的多路径融合增强网络[J]. 微电子学与计算机,2024,41(3):59-70. doi: 10.19304/J.ISSN1000-7180.2023.0172
引用本文: 沈俊晖,薛丽霞,汪荣贵,等.适用于图像超分辨率的多路径融合增强网络[J]. 微电子学与计算机,2024,41(3):59-70. doi: 10.19304/J.ISSN1000-7180.2023.0172
SHEN J H,XUE L X,WANG R G,et al. Multi-path fusion enhancement network for image super-resolution[J]. Microelectronics & Computer,2024,41(3):59-70. doi: 10.19304/J.ISSN1000-7180.2023.0172
Citation: SHEN J H,XUE L X,WANG R G,et al. Multi-path fusion enhancement network for image super-resolution[J]. Microelectronics & Computer,2024,41(3):59-70. doi: 10.19304/J.ISSN1000-7180.2023.0172

适用于图像超分辨率的多路径融合增强网络

Multi-path fusion enhancement network for image super-resolution

  • 摘要: 卷积神经网络(Convolutional Neural Network, CNN)在单幅图像的超分辨率重建方面表现出了非常强大的能力,相比传统方法有着明显的改进。然而,尽管这些方法非常成功,但是由于需要大量的计算资源,直接应用于一些边缘设备并不现实。为了解决该问题,设计了一种轻量级的图像超分辨率重建网络——多路径融合增强网络(Multi-path Fusion Enhancement Network, MFEN)。具体来说,提出了一个新颖的融合注意力增强模块(Fusion Attention Enhancement Block, FAEB)作为多路径融合增强网络的主要构建模块。融合注意力增强模块由一条主干分支和两条层级分支构成:主干分支由堆叠的增强像素注意力模块组成,负责对特征图实现深度特征学习;层级分支则负责提取并融合不同大小感受野的特征图,从而实现多尺度特征学习。层级分支的融合方式则是以相邻的增强像素注意力模块输出为分支输入,通过自适应注意力模块(Self-Adaptive Attention Module, SAAM)来动态地增强不同大小感受野特征的融合程度,进一步补全特征信息,从而实现更全面、更精准的特征学习。大量实验表明,该多路径融合增强网络在基准测试集上具有更高的准确性。

     

    Abstract: Recently, Convolutional Neural Network (CNN) has demonstrated powerful capabilities in Single Image Super Resolution (SISR) and has shown significant improvements over traditional methods. However, although these methods are very successful, they are not practical to be directly applied to some edge devices due to the large amount of computing resources required. To address this problem, a lightweight SISR network called Multi-path Fusion Enhancement Network (MFEN) is proposed. Specifically, a novel Fusion Attention Enhancement Block (FAEB) is proposed as the main building block of MFEN. The FAEB module consists of one main branch and two hierarchical branches. The main branch is composed of stacked Enhanced Pixel Attentional Blocks (EPABs), responsible for deep feature learning of the feature maps. The hierarchical branches are responsible for extracting and fusing feature maps with different sizes of receptive fields, achieving multi-scale feature learning. The fusion method for the hierarchical branches is based on the output of adjacent EPAB modules as branch inputs, and the Self-Adaptive Attention Module (SAAM) is designed to dynamically enhance the fusion degree of features with different sizes of receptive fields, achieving further feature information completion and thus achieving more comprehensive and accurate feature learning. Extensive experiments show that our MFEN achieves higher accuracy than other advanced methods on benchmark test sets.

     

/

返回文章
返回