EUVIMEDEUVIMED entdecken
Crossref

CoT-MISR:Marrying convolution and transformer for multi-image super-resolution

Qing Song, Mingming Xiu, Yang Nie, Mengjie Hu, Chun Liu

Multimedia Tools and Applications · 17.02.2024 · 83 (31) · 76891-76903

DOI: 10.1007/s11042-024-18591-4 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Multimedia Tools and Applications, online erschienen am 17.02.2024. Verfasst von Qing Song und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: National Key Research and Development Program of Chin.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Image super-resolution, a technique for image restoration, has been the subject of extensive research. The challenge lies in converting a low-resolution image to recover its high-resolution information, a problem that researchers have been persistently exploring. Early physical transformation methods often resulted in high-resolution images with significant information loss, and the edges and details were not well recovered.With advancements in hardware technology and mathematics, deep learning methods have been employed for image super-resolution tasks. These range from direct deep learning models, residual channel attention networks, bi-directional suppression networks, to networks with transformer modules, all of which have progressively yielded satisfactory results.In the realm of multi-image super-resolution, the establishment of a multi-image super-resolution dataset has facilitated the evolution from convolution models to transformer models, thereby continuously enhancing the quality of super-resolution. However, it has been observed that neither pure convolution nor pure transformer networks can effectively utilize low-resolution image information.To address this, we propose a novel end-to-end CoT-MISR network. The CoT-MISR network compensates for local and global information by leveraging the strengths of both convolution and transformer techniques. Validation on an equal parameter dataset demonstrates that our CoT-MISR network has achieved the optimal score index.

Förderung

  • National Key Research and Development Program of Chin

Zitieren

APA

Song, Q., Xiu, M., Nie, Y., Hu, M., & Liu, C. (2024). CoT-MISR:Marrying convolution and transformer for multi-image super-resolution. Multimedia Tools and Applications, 83(31), 76891-76903. https://doi.org/10.1007/s11042-024-18591-4

Vancouver

Song Q, Xiu M, Nie Y, Hu M, Liu C. CoT-MISR:Marrying convolution and transformer for multi-image super-resolution. Multimedia Tools and Applications. 2024;83(31):76891-76903. doi:10.1007/s11042-024-18591-4

BibTeX
@article{Song2024,
  author = {Song, Qing and Xiu, Mingming and Nie, Yang and Hu, Mengjie and Liu, Chun},
  title = {CoT-MISR:Marrying convolution and transformer for multi-image super-resolution},
  journal = {Multimedia Tools and Applications},
  year = {2024},
  volume = {83},
  number = {31},
  pages = {76891--76903},
  doi = {10.1007/s11042-024-18591-4}
}
Kostenlos starten →