EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Machine Learning-Based Ear Thermal Imaging for Emotion Sensing

Budu Tang, Wataru Sato iD

Sensors · 2026

DOI: 10.3390/s26041248 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2026. Verfasst von Budu Tang und 1 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, Kyoto 606-8507, Japan. Hauptthemen laut MEDLINE: Emotions, Machine Learning, Thermography, Ear. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Thermal imaging, which is contact-free, light-independent, and effective in detecting skin temperature changes that reflect autonomic nervous system activity, is expected to be useful for emotion sensing. A recent thermography study demonstrated a linear relationship between ear temperatures and emotional arousal ratings. However, whether and how ear thermal changes may be nonlinearly related to subjective emotions remains untested. To address this issue, we reanalyzed a dataset that included ear thermal images and self-reported arousal ratings obtained while participants watched emotion-eliciting films. We employed linear regression and two nonlinear machine learning models: a random forest model and a ResNet-50 convolutional neural network. Model evaluation using mean squared error and correlation coefficients between actual arousal ratings and model predictions indicated that both machine learning models outperformed linear regression and that the ResNet-50 model outperformed the random forest model. Interpretation of the ResNet-50 model using Gradient-weighted Class Activation Mapping and Shapley additive explanation methods revealed nonlinear associations between temperature changes in specific ear regions and subjective arousal ratings. These findings imply that ear thermal imaging combined with machine learning, particularly deep learning, holds promise for emotion sensing.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EmotionsMachine LearningThermographyEarHumansConvolutional Neural NetworksArousalRandom ForestFemaleSkin Temperature

Stichwörter der Autor:innen

arousal and valenceear thermal imagingemotional arousalmachine learningpixel-level analysis

Autor:innen und Institutionen

  • Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, Kyoto 606-8507, Japan.
  • Psychological Process Research Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan.

ORCID-Profile: Wataru Sato

Förderung

  • Japan Science and Technology Agency

Zitieren

APA

Tang, B., & Sato, W. (2026). Machine Learning-Based Ear Thermal Imaging for Emotion Sensing. Sensors. https://doi.org/10.3390/s26041248

Vancouver

Tang B, Sato W. Machine Learning-Based Ear Thermal Imaging for Emotion Sensing. Sensors. 2026. doi:10.3390/s26041248

BibTeX
@article{Tang2026,
  author = {Tang, Budu and Sato, Wataru},
  title = {Machine Learning-Based Ear Thermal Imaging for Emotion Sensing},
  journal = {Sensors},
  year = {2026},
  doi = {10.3390/s26041248}
}
Kostenlos starten →