AUTOMATIC DETECTION OF SPEECH INTENTIONS USING A LARGE LANGUAGE MODEL
Психологический журнал / Psikhologicheskii zhurnal · 2025 · 46 (6) · 66
DOI: 10.7868/s3034588x25060071 ↗Kurz gefasst
Fachartikel in der Zeitschrift Психологический журнал / Psikhologicheskii zhurnal, 2025. Verfasst von A.V. Vanin und 6 weiteren Autor:innen.
Abstract (Originalsprache)
The article presents the results of a study of the capabilities of the large language model (GPT-4) to identify the intentional structure of the text. In the course of the research, the following tasks were solved: to develop a methodology for classifying therapist's intentions in psychotherapeutic discourse; to create optimal instructions for working with the model; to analyze the impact of completeness of instructions on the accuracy of identifying intentions by the model; to study the relationship between the accuracy of the classification of intentions by the model with the frequency of occurrence of intentions in the text and the consistency of expert assessments. To analyze the intentional structure of texts, an original Methodology for classifying therapist's intentions in psychotherapeutic discourse has been developed. Using this technique, a team of 3 experts who make decisions about the presence of intent in a remark independently of each other conducted marking up of 14 sessions in Russian (a total of 692 replicas of the therapist). The task of identifying the therapist's intentions was solved by the "GPT-4o-mini" and "GPT-o1" models. The model revealed the intentions of the psychotherapist, realized by him in specific speech utterances (replicas). The conducted research demonstrated the significant capabilities of the large GPT-4 language model in solving the problem of identifying the speaker's speech intentions. The achieved accuracy in classifying the therapist's intentions turned out to be at the level of the best indicators obtained in works on a similar subject. It is shown that improving the instructions significantly increases the quality of the model's operation, and the complexity of the tasks assigned to the model is related to the accuracy of forecasts. Different criteria for the presence of intentions in the therapist's remarks significantly changed the accuracy of the model's predictions.
Zitieren
APA
Vanin, A., Vlasova, A., Dymova, E., Latynov, V., Panfilova, A., Sereda-Kalinin, P., & Tulyankina, A. (2025). AUTOMATIC DETECTION OF SPEECH INTENTIONS USING A LARGE LANGUAGE MODEL. Психологический журнал / Psikhologicheskii zhurnal, 46(6), 66. https://doi.org/10.7868/s3034588x25060071
Vancouver
Vanin A, Vlasova A, Dymova E, Latynov V, Panfilova A, Sereda-Kalinin P, et al. AUTOMATIC DETECTION OF SPEECH INTENTIONS USING A LARGE LANGUAGE MODEL. Психологический журнал / Psikhologicheskii zhurnal. 2025;46(6):66. doi:10.7868/s3034588x25060071
BibTeX
@article{Vanin2025,
author = {Vanin, A.V. and Vlasova, A.S. and Dymova, E.N. and Latynov, V.V. and Panfilova, A.S. and Sereda-Kalinin, P.Y. and Tulyankina, A.I.},
title = {AUTOMATIC DETECTION OF SPEECH INTENTIONS USING A LARGE LANGUAGE MODEL},
journal = {Психологический журнал / Psikhologicheskii zhurnal},
year = {2025},
volume = {46},
number = {6},
pages = {66},
doi = {10.7868/s3034588x25060071}
}
EUVIMED