Multimodal Assessment of Cognitive Workload Using Neural, Subjective and Behavioural Measures in Smart Factory Settings
Sensors · 02.11.2023 · 23 (21) · 8926
DOI: 10.3390/s23218926 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 02.11.2023. Verfasst von Zohreh Zakeri und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Engineering, School of Science and Technology, Nottingham Trent University, Clifton, Nottingham NG11 8NS, UK. Hauptthemen laut MEDLINE: Workload, Brain. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Engineering and Physical Sciences Research Council, Connected Everything (CE II) Feasibility Studies, Engineering and Physical Science Research Council, PepsiCo Europe.
Abstract (Originalsprache)
Collaborative robots (cobots) have largely replaced conventional industrial robots in today’s workplaces, particularly in manufacturing setups, due to their improved performance and intelligent design. In the framework of Industry 5.0, humans are working alongside cobots to accomplish the required level of automation. However, human–robot interaction has brought up concerns regarding human factors (HF) and ergonomics. A human worker may experience cognitive stress as a result of cobots’ irresponsive nature in unpredictably occurring situations, which adversely affects productivity. Therefore, there is a necessity to measure stress to enhance a human worker’s performance in a human–robot collaborative environment. In this study, factory workers’ mental workload was assessed using physiological, behavioural, and subjective measures. Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) signals were collected to acquire brain signals and track hemodynamic activity, respectively. The effect of task complexity, cobot movement speed, and cobot payload capacity on the mental stress of a human worker were observed for a task designed in the context of a smart factory. Task complexity and cobot speed proved to be more impactful. As physiological measures are unbiased and more authentic means to estimate stress, eventually they may replace the other conventional measures if they prove to correlate with the results of traditional ones. Here, regression and artificial neural networks (ANN) were utilised to determine the correlation between physiological data and subjective and behavioural measures. Regression performed better for most of the targets and the best correlation (rsq-adj = 0.654146) was achieved for predicting missed beeps, a behavioural measure, using a combination of multiple EEG and fNIRS predictors. The k-nearest neighbours (KNN) algorithm was used to evaluate the accuracy of correlation between traditional measures and physiological variables, with the highest accuracy of 77.8% achieved for missed beeps as the target. Results show that physiological measures can be more insightful and have the tendency to replace other biased parameters.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Engineering, School of Science and Technology, Nottingham Trent University, Clifton, Nottingham NG11 8NS, UK.
ORCID-Profile: Ahmet Omurtag, Azfar Khalid
Förderung
- Engineering and Physical Sciences Research Council
- Connected Everything (CE II) Feasibility Studies, Engineering and Physical Science Research Council
- PepsiCo Europe
Zitieren
APA
Zakeri, Z., Arif, A., Omurtag, A., Breedon, P., & Khalid, A. (2023). Multimodal Assessment of Cognitive Workload Using Neural, Subjective and Behavioural Measures in Smart Factory Settings. Sensors, 23(21), 8926. https://doi.org/10.3390/s23218926
Vancouver
Zakeri Z, Arif A, Omurtag A, Breedon P, Khalid A. Multimodal Assessment of Cognitive Workload Using Neural, Subjective and Behavioural Measures in Smart Factory Settings. Sensors. 2023;23(21):8926. doi:10.3390/s23218926
BibTeX
@article{Zakeri2023,
author = {Zakeri, Zohreh and Arif, Arshia and Omurtag, Ahmet and Breedon, Philip and Khalid, Azfar},
title = {Multimodal Assessment of Cognitive Workload Using Neural, Subjective and Behavioural Measures in Smart Factory Settings},
journal = {Sensors},
year = {2023},
volume = {23},
number = {21},
pages = {8926},
doi = {10.3390/s23218926}
}
EUVIMED