EUVIMEDEUVIMED entdecken
Crossref

SurgPub-Video: A Comprehensive Surgical Video Framework for Enhanced Surgical Intelligence in Vision-Language Model

Yaoqian Li, Xikai Yang, Dunyuan Xu, Yang YU, Litao Zhao, Xiaowei Hu, Jinpeng Li, Pheng-Ann Heng

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (8) · 6628-6635

DOI: 10.1609/aaai.v40i8.37593 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Yaoqian Li und 7 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vision-Language Models (VLMs) have shown significant potential in surgical scene analysis, yet existing models are limited by frame-level datasets and lack high-quality video data with procedural surgical knowledge. To address these challenges, we make the following contributions: (i) SurgPub-Video, a comprehensive dataset of over 3,000 surgical videos and 25 million annotated frames across 11 specialities, sourced from peer-reviewed clinical journals, (ii) SurgLLaVA-Video, a specialized VLM for surgical video understanding, built upon the TinyLLaVA-Video architecture that supports both video-level and frame-level inputs, and (iii) a video-level surgical Visual Question Answering (VQA) benchmark, covering diverse 11 surgical specialities, such as vascular, cardiology, and thoracic. Extensive experiments, conducted on the proposed benchmark and three additional surgical downstream tasks (action recognition, skill assessment, and triplet recognition), show that SurgLLaVA-Video significantly outperforms both general-purpose and surgical-specific VLMs with only three billion parameters.

Zitieren

APA

Li, Y., Yang, X., Xu, D., YU, Y., Zhao, L., Hu, X., Li, J., & Heng, P. (2026). SurgPub-Video: A Comprehensive Surgical Video Framework for Enhanced Surgical Intelligence in Vision-Language Model. Proceedings of the AAAI Conference on Artificial Intelligence, 40(8), 6628-6635. https://doi.org/10.1609/aaai.v40i8.37593

Vancouver

Li Y, Yang X, Xu D, YU Y, Zhao L, Hu X, et al. SurgPub-Video: A Comprehensive Surgical Video Framework for Enhanced Surgical Intelligence in Vision-Language Model. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(8):6628-6635. doi:10.1609/aaai.v40i8.37593

BibTeX
@article{Li2026,
  author = {Li, Yaoqian and Yang, Xikai and Xu, Dunyuan and YU, Yang and Zhao, Litao and Hu, Xiaowei and Li, Jinpeng and Heng, Pheng-Ann},
  title = {SurgPub-Video: A Comprehensive Surgical Video Framework for Enhanced Surgical Intelligence in Vision-Language Model},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {8},
  pages = {6628--6635},
  doi = {10.1609/aaai.v40i8.37593}
}
Kostenlos starten →