Lightweight Single Image Super-Resolution Convolution Neural Network in Portable Device

Jin Wang, Yiming Wu, Shiming He, Pradip Kumar Sharma, Xiaofeng Yu*, Osama Alfarraj, Amr Tolba

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Super-resolution can improve the clarity of low-resolution (LR) images, which can increase the accuracy of high-level compute vision tasks. Portable devices have low computing power and storage performance. Large-scale neural network super-resolution methods are not suitable for portable devices. In order to save the computational cost and the number of parameters, Lightweight image processing method can improve the processing speed of portable devices. Therefore, we propose the Enhanced Information Multiple Distillation Network (EIMDN) to adapt lower delay and cost. The EIMDN takes feedback mechanism as the framework and obtains low level features through high level features. Further, we replace the feature extraction convolution operation in Information Multiple Distillation Block (IMDB), with Ghost module, and propose the Enhanced Information Multiple Distillation Block (EIMDB) to reduce the amount of calculation and the number of parameters. Finally, coordinate attention (CA) is used at the end of IMDB and EIMDB to enhance the important information extraction from Spaces and channels. Experimental results show that our proposed can achieve convergence faster with fewer parameters and computation, compared with other lightweight super-resolution methods. Under the condition of higher peak signal-to-noise ratio (PSNR) and higher structural similarity (SSIM), the performance of network reconstruction image texture and target contour is significantly improved.

Original languageEnglish
Pages (from-to)4065-4083
Number of pages19
JournalKSII Transactions on Internet and Information Systems
Volume15
Issue number11
Early online date30 Nov 2021
DOIs
Publication statusPublished - 30 Nov 2021

Keywords

  • Coordinate attention
  • Deep learning
  • Feedback mechanism
  • Information distillation
  • Super-resolution

Fingerprint

Dive into the research topics of 'Lightweight Single Image Super-Resolution Convolution Neural Network in Portable Device'. Together they form a unique fingerprint.

Cite this