Electroencephalogram-Based Analysis of Monomodal and Multimodal Interaction in Mixed Reality Games
Sensors · 10.06.2026 · 26 (12) · 3690
DOI: 10.3390/s26123690 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 10.06.2026. Verfasst von Pratheep Kumar Paranthaman und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, Elon University, Elon, NC 27244, USA. Hauptthemen laut MEDLINE: Electroencephalography, Video Games. Die Arbeit nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Mixed reality (MR) technologies enable users to experience computer-generated content within the physical environment through spatial computing and head-mounted displays. By supporting real-time interaction through speech, gesture, gaze, and movement, MR offers new opportunities for game design beyond productivity and educational applications. However, relatively few studies have examined interaction modalities in MR games. In this paper, we present the design and deployment of four MR games on the Microsoft HoloLens 2: three that use monomodal input (speech, gaze, or gesture) and one that uses multimodal input (speech, gaze, and gesture). We conducted a study with ten participants and evaluated player experience using subjective self-reports of task load, emotional engagement, and comfort alongside objective measures, namely brain activity data collected with a five-channel electroencephalogram (EEG) device. Our preliminary findings suggest two clusters of interaction modalities based on subjective measures, a pattern that is also reflected in the objective EEG measures. Our analysis combining subjective and EEG data indicates that interaction modality influences task load and emotional engagement. Additionally, our functional connectivity analysis showed links in activity across the prefrontal, temporal, and occipital brain regions for different input modalities in the MR games.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Science, Elon University, Elon, NC 27244, USA.
- School of Physical and Chemical Sciences, Queen Mary University, London E1 4NS, UK.
ORCID-Profile: Pratheep Kumar Paranthaman, Nikesh Bajaj
Zitieren
APA
Paranthaman, P. K., Bajaj, N., & LaMont, L. (2026). Electroencephalogram-Based Analysis of Monomodal and Multimodal Interaction in Mixed Reality Games. Sensors, 26(12), 3690. https://doi.org/10.3390/s26123690
Vancouver
Paranthaman PK, Bajaj N, LaMont L. Electroencephalogram-Based Analysis of Monomodal and Multimodal Interaction in Mixed Reality Games. Sensors. 2026;26(12):3690. doi:10.3390/s26123690
BibTeX
@article{Paranthaman2026,
author = {Paranthaman, Pratheep Kumar and Bajaj, Nikesh and LaMont, Logan},
title = {Electroencephalogram-Based Analysis of Monomodal and Multimodal Interaction in Mixed Reality Games},
journal = {Sensors},
year = {2026},
volume = {26},
number = {12},
pages = {3690},
doi = {10.3390/s26123690}
}
EUVIMED