EUVIMEDEUVIMED entdecken
Crossref

Self-Supervised Deep Blind Video Super-Resolution

Haoran Bai, Jinshan Pan

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-07 · 46 (7) · 4641-4653

DOI: 10.1109/tpami.2024.3361168 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-07. Verfasst von Haoran Bai und 1 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Existing deep learning-based video super-resolution (SR) methods usually depend on the supervised learning approach, where the training data is usually generated by the blurring operation with known or predefined kernels (e.g., Bicubic kernel) followed by a decimation operation. However, this does not hold for real applications as the degradation process is complex and cannot be approximated by these idea cases well. Moreover, obtaining high-resolution (HR) videos and the corresponding low-resolution (LR) ones in real-world scenarios is difficult. To overcome these problems, we propose a self-supervised learning method to solve the blind video SR problem, which simultaneously estimates blur kernels and HR videos from the LR videos. As directly using LR videos as supervision usually leads to trivial solutions, we develop a simple and effective method to generate auxiliary paired data from original LR videos according to the image formation of video SR, so that the networks can be better constrained by the generated paired data for both blur kernel estimation and latent HR video restoration. In addition, we introduce an optical flow estimation module to exploit the information from adjacent frames for HR video restoration. Experiments show that our method performs favorably against state-of-the-art ones on benchmarks and real-world videos.

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Bai, H., & Pan, J. (2024). Self-Supervised Deep Blind Video Super-Resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(7), 4641-4653. https://doi.org/10.1109/tpami.2024.3361168

Vancouver

Bai H, Pan J. Self-Supervised Deep Blind Video Super-Resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(7):4641-4653. doi:10.1109/tpami.2024.3361168

BibTeX
@article{Bai2024,
  author = {Bai, Haoran and Pan, Jinshan},
  title = {Self-Supervised Deep Blind Video Super-Resolution},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2024},
  volume = {46},
  number = {7},
  pages = {4641--4653},
  doi = {10.1109/tpami.2024.3361168}
}
Kostenlos starten →