EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Home Robot Interaction Based on EEG Motor Imagery and Visual Perception Fusion

Tie Hua Zhou iD, Dongsheng Li iD, Zhiwei Jian iD, Wei Ding iD, Ling Wang iD

Sensors · 2025

DOI: 10.3390/s25175568 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Tie Hua Zhou und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science and Technology, School of Computer Science, Northeast Electric Power University, Jilin 132013, China. Hauptthemen laut MEDLINE: Electroencephalography, Robotics, Visual Perception. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science and Technology Development Plan of Jilin Province, China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Amid the intensification of demographic aging, home robots based on intelligent technology have shown great application potential in assisting the daily life of the elderly. This paper proposes a multimodal human–robot interaction system that integrates EEG signal analysis and visual perception, aiming to realize the perception ability of home robots on the intentions and environment of the elderly. Firstly, a channel selection strategy is employed to identify the most discriminative electrode channels based on Motor Imagery (MI) EEG signals; then, the signal representation ability is improved by combining Filter Bank co-Spatial Patterns (FBCSP), wavelet packet decomposition and nonlinear features, and one-to-many Support Vector Regression (SVR) is used to achieve four-class classification. Secondly, the YOLO v8 model is applied for identifying objects within indoor scenes. Subsequently, object confidence and spatial distribution are extracted, and scene recognition is performed using a Machine Learning technique. Finally, the EEG classification results are combined with the scene recognition results to establish the scene-intention correspondence, so as to realize the recognition of the intention-driven task types of the elderly in different home scenes. Performance evaluation reveals that the proposed method attains a recognition accuracy of 83.4%, which indicates that this method has good classification accuracy and practical application value in multimodal perception and human–robot collaborative interaction, and provides technical support for the development of smarter and more personalized home assistance robots.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ElectroencephalographyRoboticsVisual PerceptionHumansSupport Vector MachineAgedAlgorithmsMachine LearningSignal Processing, Computer-Assisted

Stichwörter der Autor:innen

feature fusionhome robothuman–robot interactionmotor imagery electroencephalogram (MI-EEG)scene recognition

Autor:innen und Institutionen

  • Department of Computer Science and Technology, School of Computer Science, Northeast Electric Power University, Jilin 132013, China.
  • Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center (National Supercomputer Center in Jinan), Qilu University of Technology (Shandong Academy of Sc…
  • Shandong Provincial Key Laboratory of Computer Networks, Shandong Fundamental Research Center for Computer Science, Jinan 250000, China.

ORCID-Profile: Tie Hua Zhou, Dongsheng Li, Zhiwei Jian, Wei Ding, Ling Wang

Förderung

  • Science and Technology Development Plan of Jilin Province, China

Zitieren

APA

Zhou, T. H., Li, D., Jian, Z., Ding, W., & Wang, L. (2025). Home Robot Interaction Based on EEG Motor Imagery and Visual Perception Fusion. Sensors. https://doi.org/10.3390/s25175568

Vancouver

Zhou TH, Li D, Jian Z, Ding W, Wang L. Home Robot Interaction Based on EEG Motor Imagery and Visual Perception Fusion. Sensors. 2025. doi:10.3390/s25175568

BibTeX
@article{Zhou2025,
  author = {Zhou, Tie Hua and Li, Dongsheng and Jian, Zhiwei and Ding, Wei and Wang, Ling},
  title = {Home Robot Interaction Based on EEG Motor Imagery and Visual Perception Fusion},
  journal = {Sensors},
  year = {2025},
  doi = {10.3390/s25175568}
}
Kostenlos starten →