EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

EmotionCast: An Emotion-Driven Intelligent Broadcasting System for Dynamic Camera Switching

Xinyi Zhang iD, Xinran Ba, Feng Hu, Jin Yuan

Sensors · 2024

DOI: 10.3390/s24165401 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2024. Verfasst von Xinyi Zhang und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Information and Communication Engineering, Communication University of China, Beijing 100024, China. Hauptthemen laut MEDLINE: Emotions, Facial Expression, Algorithms. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key R&D Program of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional broadcasting methods often result in fatigue and decision-making errors when dealing with complex and diverse live content. Current research on intelligent broadcasting primarily relies on preset rules and model-based decisions, which have limited capabilities for understanding emotional dynamics. To address these issues, this study proposed and developed an emotion-driven intelligent broadcasting system, EmotionCast, to enhance the efficiency of camera switching during live broadcasts through decisions based on multimodal emotion recognition technology. Initially, the system employs sensing technologies to collect real-time video and audio data from multiple cameras, utilizing deep learning algorithms to analyze facial expressions and vocal tone cues for emotion detection. Subsequently, the visual, audio, and textual analyses were integrated to generate an emotional score for each camera. Finally, the score for each camera shot at the current time point was calculated by combining the current emotion score with the optimal scores from the preceding time window. This approach ensured optimal camera switching, thereby enabling swift responses to emotional changes. EmotionCast can be applied in various sensing environments such as sports events, concerts, and large-scale performances. The experimental results demonstrate that EmotionCast excels in switching accuracy, emotional resonance, and audience satisfaction, significantly enhancing emotional engagement compared to traditional broadcasting methods.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EmotionsFacial ExpressionAlgorithmsHumansDeep LearningVideo Recording

Stichwörter der Autor:innen

emotion recognitionintelligent broadcastingmultimodal data processing

Autor:innen und Institutionen

  • School of Information and Communication Engineering, Communication University of China, Beijing 100024, China.

ORCID-Profile: Xinyi Zhang

Förderung

  • National Key R&D Program of China

Zitieren

APA

Zhang, X., Ba, X., Hu, F., & Yuan, J. (2024). EmotionCast: An Emotion-Driven Intelligent Broadcasting System for Dynamic Camera Switching. Sensors. https://doi.org/10.3390/s24165401

Vancouver

Zhang X, Ba X, Hu F, Yuan J. EmotionCast: An Emotion-Driven Intelligent Broadcasting System for Dynamic Camera Switching. Sensors. 2024. doi:10.3390/s24165401

BibTeX
@article{Zhang2024,
  author = {Zhang, Xinyi and Ba, Xinran and Hu, Feng and Yuan, Jin},
  title = {EmotionCast: An Emotion-Driven Intelligent Broadcasting System for Dynamic Camera Switching},
  journal = {Sensors},
  year = {2024},
  doi = {10.3390/s24165401}
}
Kostenlos starten →