EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Unveiling the Potential of ChatGPT and YOLOv7 for Evaluating Children’s Emotions Using Their Artistic Expressions

Uzair Shah, Sulaiman Khan, Mahmood Alzubaidi, Marco Agus, Mowafa Househ

Studies in Health Technology and Informatics · 2024

DOI: 10.3233/shti240434 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, 2024. Verfasst von Uzair Shah und 4 weiteren Autor:innen. Beteiligte Einrichtung: College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar. Hauptthemen laut MEDLINE: Emotions, Natural Language Processing. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advancements in large language models (LLMs) have sparked considerable interest in their potential applications across various healthcare domains. One promising prospect is leveraging these generative models to accurately predict children’s emotions by combining computer vision and natural language processing techniques. However, understanding children’s emotional states based on their artistic expressions is equally crucial. To address this challenge, this paper presents a pipelined architecture comprising YOLOv7 and the powerful GPT-3.5 Turbo language model, where YOLOv7 is employed for object detection using art therapy imaging annotations, while GPT-3.5 interprets the sketches. After rigorously evaluating the proposed framework through a series of comprehensive experiments, we observed that our model achieved high confidence scores for both object detection and emotion interpretation. The robust performance of the proposed framework not only aids in explaining children’s art but also provides valuable insights for parents and therapists. This capability enables them to better understand children’s emotional states based on their artistic expressions, ultimately facilitating improved support and care.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EmotionsNatural Language ProcessingHumansChildArt TherapyArt

Stichwörter der Autor:innen

ChatGPTEmotion sensingKids drawingLLMYOLOv7

Autor:innen und Institutionen

  • College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar.

Zitieren

APA

Shah, U., Khan, S., Alzubaidi, M., Agus, M., & Househ, M. (2024). Unveiling the Potential of ChatGPT and YOLOv7 for Evaluating Children’s Emotions Using Their Artistic Expressions. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti240434

Vancouver

Shah U, Khan S, Alzubaidi M, Agus M, Househ M. Unveiling the Potential of ChatGPT and YOLOv7 for Evaluating Children’s Emotions Using Their Artistic Expressions. Studies in Health Technology and Informatics. 2024. doi:10.3233/shti240434

BibTeX
@article{Shah2024,
  author = {Shah, Uzair and Khan, Sulaiman and Alzubaidi, Mahmood and Agus, Marco and Househ, Mowafa},
  title = {Unveiling the Potential of ChatGPT and YOLOv7 for Evaluating Children’s Emotions Using Their Artistic Expressions},
  journal = {Studies in Health Technology and Informatics},
  year = {2024},
  doi = {10.3233/shti240434}
}
Kostenlos starten →