EmotionCast: An Emotion-Driven Intelligent Broadcasting System for Dynamic Camera Switching
Sensors · 2024
DOI: 10.3390/s24165401 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2024. Verfasst von Xinyi Zhang und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Information and Communication Engineering, Communication University of China, Beijing 100024, China. Hauptthemen laut MEDLINE: Emotions, Facial Expression, Algorithms. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key R&D Program of China.
Abstract (Originalsprache)
Traditional broadcasting methods often result in fatigue and decision-making errors when dealing with complex and diverse live content. Current research on intelligent broadcasting primarily relies on preset rules and model-based decisions, which have limited capabilities for understanding emotional dynamics. To address these issues, this study proposed and developed an emotion-driven intelligent broadcasting system, EmotionCast, to enhance the efficiency of camera switching during live broadcasts through decisions based on multimodal emotion recognition technology. Initially, the system employs sensing technologies to collect real-time video and audio data from multiple cameras, utilizing deep learning algorithms to analyze facial expressions and vocal tone cues for emotion detection. Subsequently, the visual, audio, and textual analyses were integrated to generate an emotional score for each camera. Finally, the score for each camera shot at the current time point was calculated by combining the current emotion score with the optimal scores from the preceding time window. This approach ensured optimal camera switching, thereby enabling swift responses to emotional changes. EmotionCast can be applied in various sensing environments such as sports events, concerts, and large-scale performances. The experimental results demonstrate that EmotionCast excels in switching accuracy, emotional resonance, and audience satisfaction, significantly enhancing emotional engagement compared to traditional broadcasting methods.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Information and Communication Engineering, Communication University of China, Beijing 100024, China.
ORCID-Profile: Xinyi Zhang
Förderung
- National Key R&D Program of China
Zitieren
APA
Zhang, X., Ba, X., Hu, F., & Yuan, J. (2024). EmotionCast: An Emotion-Driven Intelligent Broadcasting System for Dynamic Camera Switching. Sensors. https://doi.org/10.3390/s24165401
Vancouver
Zhang X, Ba X, Hu F, Yuan J. EmotionCast: An Emotion-Driven Intelligent Broadcasting System for Dynamic Camera Switching. Sensors. 2024. doi:10.3390/s24165401
BibTeX
@article{Zhang2024,
author = {Zhang, Xinyi and Ba, Xinran and Hu, Feng and Yuan, Jin},
title = {EmotionCast: An Emotion-Driven Intelligent Broadcasting System for Dynamic Camera Switching},
journal = {Sensors},
year = {2024},
doi = {10.3390/s24165401}
}
EUVIMED