EUVIMEDEUVIMED entdecken
Crossref

Object Segmentation-Assisted Inter Prediction for Versatile Video Coding

Zhuoyuan Li, Zikun Yuan, Li Li, Dong Liu, Xiaohu Tang, Feng Wu

IEEE Transactions on Broadcasting · 2024-12 · 70 (4) · 1236-1253

DOI: 10.1109/tbc.2024.3434520 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Broadcasting, 2024-12. Verfasst von Zhuoyuan Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 45-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In modern video coding standards, block-based inter prediction is widely adopted, which brings high compression efficiency. However, in natural videos, there are usually multiple moving objects of arbitrary shapes, resulting in complex motion fields that are difficult to represent compactly. This problem has been tackled by more flexible block partitioning methods in the Versatile Video Coding (VVC) standard, but the more flexible partitions require more overhead bits to signal and still cannot be made arbitrarily shaped. To address this limitation, we propose an object segmentation-assisted inter prediction method (SAIP), where objects in the reference frames are segmented by some advanced technologies. With a proper indication, the object segmentation mask is translated from the reference frame to the current frame as the arbitrary-shaped partition of different regions without any extra signal. Using the segmentation mask, motion compensation is separately performed for different regions, achieving higher prediction accuracy. The segmentation mask is further used to code the motion vectors of different regions more efficiently. Moreover, the segmentation mask is considered in the joint rate-distortion optimization for motion estimation and partition estimation to derive the motion vector of different regions and partition more accurately. The proposed method is implemented into the VVC reference software, VTM version 12.0. Experimental results show that the proposed method achieves up to 1.98%, 1.14%, 0.79%, and on average 0.82%, 0.49%, 0.37% BD-rate reduction for common test sequences, under the Low-delay P, Low-delay B, and Random Access configurations, respectively.

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Li, Z., Yuan, Z., Li, L., Liu, D., Tang, X., & Wu, F. (2024). Object Segmentation-Assisted Inter Prediction for Versatile Video Coding. IEEE Transactions on Broadcasting, 70(4), 1236-1253. https://doi.org/10.1109/tbc.2024.3434520

Vancouver

Li Z, Yuan Z, Li L, Liu D, Tang X, Wu F. Object Segmentation-Assisted Inter Prediction for Versatile Video Coding. IEEE Transactions on Broadcasting. 2024;70(4):1236-1253. doi:10.1109/tbc.2024.3434520

BibTeX
@article{Li2024,
  author = {Li, Zhuoyuan and Yuan, Zikun and Li, Li and Liu, Dong and Tang, Xiaohu and Wu, Feng},
  title = {Object Segmentation-Assisted Inter Prediction for Versatile Video Coding},
  journal = {IEEE Transactions on Broadcasting},
  year = {2024},
  volume = {70},
  number = {4},
  pages = {1236--1253},
  doi = {10.1109/tbc.2024.3434520}
}
Kostenlos starten →