Lightweight Single Image Super-Resolution Convolution Neural Network in Portable Device

Jin Wang, Yiming Wu, Shiming He, Pradip Kumar Sharma, Xiaofeng Yu*, Osama Alfarraj, Amr Tolba

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

34 Citations (Scopus)

Abstract

Super-resolution can improve the clarity of low-resolution (LR) images, which can increase the accuracy of high-level compute vision tasks. Portable devices have low computing power and storage performance. Large-scale neural network super-resolution methods are not suitable for portable devices. In order to save the computational cost and the number of parameters, Lightweight image processing method can improve the processing speed of portable devices. Therefore, we propose the Enhanced Information Multiple Distillation Network (EIMDN) to adapt lower delay and cost. The EIMDN takes feedback mechanism as the framework and obtains low level features through high level features. Further, we replace the feature extraction convolution operation in Information Multiple Distillation Block (IMDB), with Ghost module, and propose the Enhanced Information Multiple Distillation Block (EIMDB) to reduce the amount of calculation and the number of parameters. Finally, coordinate attention (CA) is used at the end of IMDB and EIMDB to enhance the important information extraction from Spaces and channels. Experimental results show that our proposed can achieve convergence faster with fewer parameters and computation, compared with other lightweight super-resolution methods. Under the condition of higher peak signal-to-noise ratio (PSNR) and higher structural similarity (SSIM), the performance of network reconstruction image texture and target contour is significantly improved.

Original languageEnglish
Pages (from-to)4065-4083
Number of pages19
JournalKSII Transactions on Internet and Information Systems
Volume15
Issue number11
Early online date30 Nov 2021
DOIs
Publication statusPublished - 30 Nov 2021

Bibliographical note

This work was funded by the Researchers Supporting Project No. (RSP‐2021/102) King Saud University, Riyadh, Saudi Arabia. We thank Researchers Supporting Project No. (61772454, 62072056) National Natural Science Foundation of China, for funding this research, and Project No. (JITC-1900AX2038/01) Programs of Transformation and Upgrading of Industries and Information Technologies of Jiangsu Province, for funding this research.

Keywords

  • Coordinate attention
  • Deep learning
  • Feedback mechanism
  • Information distillation
  • Super-resolution

Fingerprint

Dive into the research topics of 'Lightweight Single Image Super-Resolution Convolution Neural Network in Portable Device'. Together they form a unique fingerprint.

Cite this