Transformers in image super-resolution: a brief review

2024

Full text Open access: Green Metadata (CSL-JSON)
DOI 10.1117/12.3054855
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Since the advent of deep learning a decade ago convolutional neural networks have been the predominant method for approaching computer vision tasks. However, Transformer model, which has shown significant achievements in the field of natural language processing, is increasingly being applied to computer vision tasks and is demonstrating comparable or superior performance. The article discusses the application of Transformer model to the super-resolution task. The direct application of the original Transformer achieved performance comparable to the contemporary convolutional neural networks. However, the self-attention mechanism, which underpins Transformer model, involves quadratic computational complexity with respect to the size of the input image, presenting a significant challenge for processing high-resolution images. Further research has significantly improved performance, but these improvements are not exhaustive. An overview and comparative analysis of these studies are presented.