Machine Learning-Based Ear Thermal Imaging for Emotion Sensing
Sensors · 2026
DOI: 10.3390/s26041248 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2026. Verfasst von Budu Tang und 1 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, Kyoto 606-8507, Japan. Hauptthemen laut MEDLINE: Emotions, Machine Learning, Thermography, Ear. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency.
Abstract (Originalsprache)
Thermal imaging, which is contact-free, light-independent, and effective in detecting skin temperature changes that reflect autonomic nervous system activity, is expected to be useful for emotion sensing. A recent thermography study demonstrated a linear relationship between ear temperatures and emotional arousal ratings. However, whether and how ear thermal changes may be nonlinearly related to subjective emotions remains untested. To address this issue, we reanalyzed a dataset that included ear thermal images and self-reported arousal ratings obtained while participants watched emotion-eliciting films. We employed linear regression and two nonlinear machine learning models: a random forest model and a ResNet-50 convolutional neural network. Model evaluation using mean squared error and correlation coefficients between actual arousal ratings and model predictions indicated that both machine learning models outperformed linear regression and that the ResNet-50 model outperformed the random forest model. Interpretation of the ResNet-50 model using Gradient-weighted Class Activation Mapping and Shapley additive explanation methods revealed nonlinear associations between temperature changes in specific ear regions and subjective arousal ratings. These findings imply that ear thermal imaging combined with machine learning, particularly deep learning, holds promise for emotion sensing.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, Kyoto 606-8507, Japan.
- Psychological Process Research Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan.
ORCID-Profile: Wataru Sato
Förderung
- Japan Science and Technology Agency
Zitieren
APA
Tang, B., & Sato, W. (2026). Machine Learning-Based Ear Thermal Imaging for Emotion Sensing. Sensors. https://doi.org/10.3390/s26041248
Vancouver
Tang B, Sato W. Machine Learning-Based Ear Thermal Imaging for Emotion Sensing. Sensors. 2026. doi:10.3390/s26041248
BibTeX
@article{Tang2026,
author = {Tang, Budu and Sato, Wataru},
title = {Machine Learning-Based Ear Thermal Imaging for Emotion Sensing},
journal = {Sensors},
year = {2026},
doi = {10.3390/s26041248}
}
EUVIMED