Can Graduate Students Rate Personality Reliably in Psychoanalytic Treatments Using the Shedler-Westen Assessment Procedure (SWAP-200)?
Psychodynamic Psychiatry · 2025
DOI: 10.1521/pdps.2025.53.1.102 ↗Kurz gefasst
Fachartikel in der Zeitschrift Psychodynamic Psychiatry, 2025. Verfasst von Daniel S Spina und 7 weiteren Autor:innen. Beteiligte Einrichtung: Pennsylvania State University, Department of Psychology, University Park, Pennsylvania, USA. Hauptthemen laut MEDLINE: Psychoanalytic Therapy, Personality Assessment, Personality Disorders, Personality. Die Arbeit nennt 42 Literaturangaben.
Abstract (Originalsprache)
Introduction
Psychotherapy researchers often recruit students to code psychotherapy process and outcome variables on individual therapy sessions. To do so, graduate students read verbatim psychotherapy transcripts, listen to audio or watch video of psychotherapy sessions, and then rate process and outcome measures on these sessions. Although prior studies have investigated the reliability and validity of graduate student ratings of personality dysfunction, no current study has investigated the reliability and validity of these ratings made on the basis of psychotherapy transcripts and audio. In this study, we evaluated the degree to which graduate students can reliably and validly code observer-rated personality assessments on the Shedler-Westen Assessment Procedure-200 (SWAP-200).
Methods
We related graduate student and experienced clinician-researcher's SWAP-200 scores in an existing dataset of 27 patients undergoing psychoanalytic psychotherapy at early and late phases of treatment.
Results
Using truth and bias multilevel models, we found that graduate students tended to underestimate personality pathology at the early phase of treatment and overestimate pathology at the late phase in treatment. These responses resulted in smaller effect sizes in the graduate student ratings, such that patients' personality functioning did not appear to change following treatment. By contrast, the experienced clinician's scores supported moderate to large effect sizes in personality change.
Discussion
These deviations from expert judgment may have significant ramifications for evaluating pre and post effect sizes in psychotherapy process studies using graduate student coding. Suggestions for research and practice are discussed.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Pennsylvania State University, Department of Psychology, University Park, Pennsylvania, USA.
- Arts and Sciences, New York University, Shanghai, China.
- Yeshiva University, Ferkauf Graduate School of Psychology, New York, NY, USA.
- Sapienza University of Rome, Department of Dynamic and Clinical Psychology and Health Studies, Rome, Italy.
- European University of Rome, Department of Health and Life Sciences, Rome, Italy.
- Psychoanalytic Research Consortium, New York, USA; Department of Psychology, Hofstra University, New York, USA; Derner Institute, Adelphi University, Garden City, New York, USA.
Zitieren
APA
Spina, D. S., Aafjes-van Doorn, K., Horne, S. J., Gazzillo, F., Genova, F., Gorman, B. S., Stukenberg, K., & Waldron, S. (2025). Can Graduate Students Rate Personality Reliably in Psychoanalytic Treatments Using the Shedler-Westen Assessment Procedure (SWAP-200)?. Psychodynamic Psychiatry. https://doi.org/10.1521/pdps.2025.53.1.102
Vancouver
Spina DS, Aafjes-van Doorn K, Horne SJ, Gazzillo F, Genova F, Gorman BS, et al. Can Graduate Students Rate Personality Reliably in Psychoanalytic Treatments Using the Shedler-Westen Assessment Procedure (SWAP-200)?. Psychodynamic Psychiatry. 2025. doi:10.1521/pdps.2025.53.1.102
BibTeX
@article{Spina2025,
author = {Spina, Daniel S and Aafjes-van Doorn, Katie and Horne, Sarah J and Gazzillo, Francesco and Genova, Federica and Gorman, Bernard S and Stukenberg, Karl and Waldron, Sherwood},
title = {Can Graduate Students Rate Personality Reliably in Psychoanalytic Treatments Using the Shedler-Westen Assessment Procedure (SWAP-200)?},
journal = {Psychodynamic Psychiatry},
year = {2025},
doi = {10.1521/pdps.2025.53.1.102}
}
EUVIMED