Measuring Alliance and Symptom Severity in Psychotherapy Transcripts Using Bert Topic Modeling
Administration and Policy in Mental Health and Mental Health Services Research · 2024
DOI: 10.1007/s10488-024-01356-4 ↗Kurz gefasst
Fachartikel in der Zeitschrift Administration and Policy in Mental Health and Mental Health Services Research, 2024. Verfasst von Christopher Lalk und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, Osnabrück University, Osnabrück, Germany. Christopher.lalk@uni-osnabrueck.de. Hauptthemen laut MEDLINE: Psychotherapy, Therapeutic Alliance. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: German Research Foundation (DFG), Universität Osnabrück.
Abstract (Originalsprache)
We aim to use topic modeling, an approach for discovering clusters of related words (“topics”), to predict symptom severity and therapeutic alliance in psychotherapy transcripts, while also identifying the most important topics and overarching themes for prediction. We analyzed 552 psychotherapy transcripts from 124 patients. Using BERTopic (Grootendorst, 2022), we extracted 250 topics each for patient and therapist speech. These topics were used to predict symptom severity and alliance with various competing machine-learning methods. Sensitivity analyses were calculated for a model based on 50 topics, LDA-based topic modeling, and a bigram model. Additionally, we grouped topics into themes using qualitative analysis and identified key topics and themes with eXplainable Artificial Intelligence (XAI). Symptom severity could be predicted with highest accuracy by patient topics ( $$r$$ r =0.45, 95%-CI 0.40, 0.51), whereas alliance was better predicted by therapist topics ( $$r$$ r =0.20, 95%-CI 0.16, 0.24). Drivers for symptom severity were themes related to health and negative experiences. Lower alliance was correlated with various themes, especially psychotherapy framework, income, and everyday life. This analysis shows the potential of using topic modeling in psychotherapy research allowing to predict several treatment-relevant metrics with reasonable accuracy. Further, the use of XAI allows for an analysis of the individual predictive value of topics and themes. Limitations entail heterogeneity across different topic modeling hyperparameters and a relatively small sample size.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychology, Osnabrück University, Osnabrück, Germany. Christopher.lalk@uni-osnabrueck.de.
- Department of Psychology, Osnabrück University, Osnabrück, Germany.
- Department of Psychology, University of Trier, Trier, Germany.
ORCID-Profile: Christopher Lalk
Förderung
- German Research Foundation (DFG)
- Universität Osnabrück
Zitieren
APA
Lalk, C., Steinbrenner, T., Kania, W., Popko, A., Wester, R., Schaffrath, J., Eberhardt, S., Schwartz, B., Lutz, W., & Rubel, J. (2024). Measuring Alliance and Symptom Severity in Psychotherapy Transcripts Using Bert Topic Modeling. Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-024-01356-4
Vancouver
Lalk C, Steinbrenner T, Kania W, Popko A, Wester R, Schaffrath J, et al. Measuring Alliance and Symptom Severity in Psychotherapy Transcripts Using Bert Topic Modeling. Administration and Policy in Mental Health and Mental Health Services Research. 2024. doi:10.1007/s10488-024-01356-4
BibTeX
@article{Lalk2024,
author = {Lalk, Christopher and Steinbrenner, Tobias and Kania, Weronika and Popko, Alexander and Wester, Robin and Schaffrath, Jana and Eberhardt, Steffen and Schwartz, Brian and Lutz, Wolfgang and Rubel, Julian},
title = {Measuring Alliance and Symptom Severity in Psychotherapy Transcripts Using Bert Topic Modeling},
journal = {Administration and Policy in Mental Health and Mental Health Services Research},
year = {2024},
doi = {10.1007/s10488-024-01356-4}
}
EUVIMED