EUVIMEDEUVIMED entdecken
Crossref

HMFVC: A Human–Machine Friendly Video Compression Scheme

Zhimeng Huang, Chuanmin Jia, Shanshe Wang, Siwei Ma

IEEE Transactions on Circuits and Systems for Video Technology · 2025-04 · 35 (4) · 3757-3769

DOI: 10.1109/tcsvt.2022.3207596 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-04. Verfasst von Zhimeng Huang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: National Natural Science Foundation of China, High Performance Computing Platform of Peking University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent studies on Video Coding for Machine (VCM) have achieved remarkable results. However, in practical visual-analytic applications, except for transmitting the visual feature for machine analysis, video textures are also mandatory for human monitoring and decision-making. To this end, this paper proposes a human-machine friendly video compression scheme (HMFVC) which can satisfy both human viewing and machine analysis well. First, we propose a learned semantic representation (LSR) method to extract semantic information between temporal neighboring frames. LSR could be utilized in signal reconstruction for human viewing and visual analysis for machine understanding. Second, given the proposed LSR, we design an end-to-end optimized video compression framework to jointly optimize the visual quality for human perception, analysis accuracy for machines, and compression efficiency as well. Finally, an HMFVC codec is developed, which can achieve higher action recognition accuracy and better reconstruction quality than the traditional codecs and learned video compression approaches. Specifically, HMFVC saves 77% bitrate to achieve the same analysis performance with the original videos compared to x265. To our knowledge, HMFVC is the first end-to-end optimized video compression scheme to serve both humans and machines. It is a promising framework for human-machine friendly video compression approaches.

Förderung

  • National Natural Science Foundation of China
  • High Performance Computing Platform of Peking University

Zitieren

APA

Huang, Z., Jia, C., Wang, S., & Ma, S. (2025). HMFVC: A Human–Machine Friendly Video Compression Scheme. IEEE Transactions on Circuits and Systems for Video Technology, 35(4), 3757-3769. https://doi.org/10.1109/tcsvt.2022.3207596

Vancouver

Huang Z, Jia C, Wang S, Ma S. HMFVC: A Human–Machine Friendly Video Compression Scheme. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(4):3757-3769. doi:10.1109/tcsvt.2022.3207596

BibTeX
@article{Huang2025,
  author = {Huang, Zhimeng and Jia, Chuanmin and Wang, Shanshe and Ma, Siwei},
  title = {HMFVC: A Human–Machine Friendly Video Compression Scheme},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2025},
  volume = {35},
  number = {4},
  pages = {3757--3769},
  doi = {10.1109/tcsvt.2022.3207596}
}
Kostenlos starten →