EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Large language models for depression recognition in spoken language integrating psychological knowledge

Yupei Li, Shuaijie Shao, Manuel Milling, Björn W. Schuller

Frontiers in Computer Science · 22.08.2025 · 7

DOI: 10.3389/fcomp.2025.1629725 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Computer Science, online erschienen am 22.08.2025. Verfasst von Yupei Li und 3 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Depression is a growing concern gaining attention in both public discourse and AI research. While deep neural networks (DNNs) have been used for its recognition, they still lack real-world effectiveness. Large language models (LLMs) show strong potential but require domain-specific fine-tuning and struggle with non-textual cues. Since depression is often expressed through vocal tone and behavior rather than explicit text, relying on language alone is insufficient. Diagnostic accuracy also suffers without incorporating psychological expertise. To address these limitations, we present, to the best of our knowledge, the first application of LLMs to multimodal depression detection using the DAIC-WOZ dataset. We extract the audio features using the pre-trained model Wav2Vec, and map them to text-based LLMs for further processing. We also propose a novel strategy for incorporating psychological knowledge into LLMs to enhance diagnostic performance, specifically using a question and answer set to grant authorized knowledge to LLMs. Our approach yields a notable improvement in both Mean Absolute Error (MAE) and Root Mean Square Error (RMSE) compared to a base score proposed by the related original paper. The codes are available in Github .

Zitieren

APA

Li, Y., Shao, S., Milling, M., & Schuller, B. W. (2025). Large language models for depression recognition in spoken language integrating psychological knowledge. Frontiers in Computer Science, 7. https://doi.org/10.3389/fcomp.2025.1629725

Vancouver

Li Y, Shao S, Milling M, Schuller BW. Large language models for depression recognition in spoken language integrating psychological knowledge. Frontiers in Computer Science. 2025;7. doi:10.3389/fcomp.2025.1629725

BibTeX
@article{Li2025,
  author = {Li, Yupei and Shao, Shuaijie and Milling, Manuel and Schuller, Björn W.},
  title = {Large language models for depression recognition in spoken language integrating psychological knowledge},
  journal = {Frontiers in Computer Science},
  year = {2025},
  volume = {7},
  doi = {10.3389/fcomp.2025.1629725}
}
Kostenlos starten →