EUVIMEDEUVIMED entdecken
Crossref

StabStitch++: Unsupervised Online Video Stitching With Spatiotemporal Bidirectional Warps

Lang Nie, Chunyu Lin, Kang Liao, Yun Zhang, Shuaicheng Liu, Yao Zhao

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-09 · 47 (9) · 7443-7456

DOI: 10.1109/tpami.2025.3568829 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-09. Verfasst von Lang Nie und 5 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 70 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Open Fund of Zhejiang Key Laboratory of Film and TV Media Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We retarget video stitching to an emerging issue, named warping shake, which unveils the temporal content shakes induced by sequentially unsmooth warps when extending image stitching to video stitching. Even if the input videos are stable, the stitched video can inevitably cause undesired warping shakes and affect the visual experience. To address this issue, we propose StabStitch++, a novel video stitching framework to realize spatial stitching and temporal stabilization with unsupervised learning simultaneously. First, different from existing learning-based image stitching solutions that typically warp one image to align with another, we suppose a virtual midplane between original image planes and project them onto it. Concretely, we design a differentiable bidirectional decomposition module to disentangle the homography transformation and incorporate it into our spatial warp, evenly spreading alignment burdens and projective distortions across two views. Then, inspired by camera paths in video stabilization, we derive the mathematical expression of stitching trajectories in video stitching by elaborately integrating spatial and temporal warps. Finally, a warp smoothing model is presented to produce stable stitched videos with a hybrid loss to simultaneously encourage content alignment, trajectory smoothness, and online collaboration. Compared with StabStitch that sacrifices alignment for stabilization, StabStitch++ makes no compromise and optimizes both of them simultaneously, especially in the online mode. To establish an evaluation benchmark and train the learning framework, we build a video stitching dataset with a rich diversity in camera motions and scenes. Experiments exhibit that StabStitch++ surpasses current solutions in stitching performance, robustness, and efficiency, offering compelling advancements in this field by building a real-time online video stitching system.

Förderung

  • National Natural Science Foundation of China
  • Open Fund of Zhejiang Key Laboratory of Film and TV Media Technology

Zitieren

APA

Nie, L., Lin, C., Liao, K., Zhang, Y., Liu, S., & Zhao, Y. (2025). StabStitch++: Unsupervised Online Video Stitching With Spatiotemporal Bidirectional Warps. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(9), 7443-7456. https://doi.org/10.1109/tpami.2025.3568829

Vancouver

Nie L, Lin C, Liao K, Zhang Y, Liu S, Zhao Y. StabStitch++: Unsupervised Online Video Stitching With Spatiotemporal Bidirectional Warps. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(9):7443-7456. doi:10.1109/tpami.2025.3568829

BibTeX
@article{Nie2025,
  author = {Nie, Lang and Lin, Chunyu and Liao, Kang and Zhang, Yun and Liu, Shuaicheng and Zhao, Yao},
  title = {StabStitch++: Unsupervised Online Video Stitching With Spatiotemporal Bidirectional Warps},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  volume = {47},
  number = {9},
  pages = {7443--7456},
  doi = {10.1109/tpami.2025.3568829}
}
Kostenlos starten →