EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Vision-language model-based human-robot collaboration for smart manufacturing: A state-of-the-art survey

Junming Fan, Yue Yin, Tian Wang, Wenhang Dong, Pai Zheng, Lihui Wang

Frontiers of Engineering Management · 2025-03 · 12 (1) · 177-200

DOI: 10.1007/s42524-025-4136-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers of Engineering Management, online erschienen am 22.01.2025. Verfasst von Junming Fan und 5 weiteren Autor:innen. Die Arbeit wurde bisher 51-mal zitiert (Crossref) und nennt 112 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

human-robot collaboration (HRC) is set to transform the manufacturing paradigm by leveraging the strengths of human flexibility and robot precision. The recent breakthrough of Large Language Models (LLMs) and Vision-Language Models (VLMs) has motivated the preliminary explorations and adoptions of these models in the smart manufacturing field. However, despite the considerable amount of effort, existing research mainly focused on individual components without a comprehensive perspective to address the full potential of VLMs, especially for HRC in smart manufacturing scenarios. To fill the gap, this work offers a systematic review of the latest advancements and applications of VLMs in HRC for smart manufacturing, which covers the fundamental architectures and pretraining methodologies of LLMs and VLMs, their applications in robotic task planning, navigation, and manipulation, and role in enhancing human–robot skill transfer through multimodal data integration. Lastly, the paper discusses current limitations and future research directions in VLM-based HRC, highlighting the trend in fully realizing the potential of these technologies for smart manufacturing.

Zitieren

APA

Fan, J., Yin, Y., Wang, T., Dong, W., Zheng, P., & Wang, L. (2025). Vision-language model-based human-robot collaboration for smart manufacturing: A state-of-the-art survey. Frontiers of Engineering Management, 12(1), 177-200. https://doi.org/10.1007/s42524-025-4136-9

Vancouver

Fan J, Yin Y, Wang T, Dong W, Zheng P, Wang L. Vision-language model-based human-robot collaboration for smart manufacturing: A state-of-the-art survey. Frontiers of Engineering Management. 2025;12(1):177-200. doi:10.1007/s42524-025-4136-9

BibTeX
@article{Fan2025,
  author = {Fan, Junming and Yin, Yue and Wang, Tian and Dong, Wenhang and Zheng, Pai and Wang, Lihui},
  title = {Vision-language model-based human-robot collaboration for smart manufacturing: A state-of-the-art survey},
  journal = {Frontiers of Engineering Management},
  year = {2025},
  volume = {12},
  number = {1},
  pages = {177--200},
  doi = {10.1007/s42524-025-4136-9}
}
Kostenlos starten →