Unveiling the Potential of ChatGPT and YOLOv7 for Evaluating Children’s Emotions Using Their Artistic Expressions
Studies in Health Technology and Informatics · 2024
DOI: 10.3233/shti240434 ↗Kurz gefasst
Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, 2024. Verfasst von Uzair Shah und 4 weiteren Autor:innen. Beteiligte Einrichtung: College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar. Hauptthemen laut MEDLINE: Emotions, Natural Language Processing. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Themen: Kinderkrankenpflege, Künstliche Intelligenz in der Pflege
Abstract (Originalsprache)
Recent advancements in large language models (LLMs) have sparked considerable interest in their potential applications across various healthcare domains. One promising prospect is leveraging these generative models to accurately predict children’s emotions by combining computer vision and natural language processing techniques. However, understanding children’s emotional states based on their artistic expressions is equally crucial. To address this challenge, this paper presents a pipelined architecture comprising YOLOv7 and the powerful GPT-3.5 Turbo language model, where YOLOv7 is employed for object detection using art therapy imaging annotations, while GPT-3.5 interprets the sketches. After rigorously evaluating the proposed framework through a series of comprehensive experiments, we observed that our model achieved high confidence scores for both object detection and emotion interpretation. The robust performance of the proposed framework not only aids in explaining children’s art but also provides valuable insights for parents and therapists. This capability enables them to better understand children’s emotional states based on their artistic expressions, ultimately facilitating improved support and care.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar.
Zitieren
APA
Shah, U., Khan, S., Alzubaidi, M., Agus, M., & Househ, M. (2024). Unveiling the Potential of ChatGPT and YOLOv7 for Evaluating Children’s Emotions Using Their Artistic Expressions. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti240434
Vancouver
Shah U, Khan S, Alzubaidi M, Agus M, Househ M. Unveiling the Potential of ChatGPT and YOLOv7 for Evaluating Children’s Emotions Using Their Artistic Expressions. Studies in Health Technology and Informatics. 2024. doi:10.3233/shti240434
BibTeX
@article{Shah2024,
author = {Shah, Uzair and Khan, Sulaiman and Alzubaidi, Mahmood and Agus, Marco and Househ, Mowafa},
title = {Unveiling the Potential of ChatGPT and YOLOv7 for Evaluating Children’s Emotions Using Their Artistic Expressions},
journal = {Studies in Health Technology and Informatics},
year = {2024},
doi = {10.3233/shti240434}
}
EUVIMED