EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing questioning skills through child avatar chatbot training with feedback

Ragnhild Klingenberg Røed, Gunn Astrid Baugerud, Syed Zohaib Hassan, Saeed S Sabet, Pegah Salehi, Martine B Powell, Michael A Riegler, Pål Halvorsen, Miriam S Johnson

Frontiers in Psychology · 13.07.2023 · 14

DOI: 10.3389/fpsyg.2023.1198235 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Psychology, online erschienen am 13.07.2023. Verfasst von Ragnhild Klingenberg Røed und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Social Work, Child Welfare and Social Policy, Faculty of Social Science, Oslo Metropolitan University, Oslo, Norway. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Training child investigative interviewing skills is a specialized task. Those being trained need opportunities to practice their skills in realistic settings and receive immediate feedback. A key step in ensuring the availability of such opportunities is to develop a dynamic, conversational avatar, using artificial intelligence (AI) technology that can provide implicit and explicit feedback to trainees. In the iterative process, use of a chatbot avatar to test the language and conversation model is crucial. The model is fine-tuned with interview data and realistic scenarios. This study used a pre-post training design to assess the learning effects on questioning skills across four child interview sessions that involved training with a child avatar chatbot fine-tuned with interview data and realistic scenarios. Thirty university students from the areas of child welfare, social work, and psychology were divided into two groups; one group received direct feedback ( n = 12), whereas the other received no feedback ( n = 18). An automatic coding function in the language model identified the question types. Information on question types was provided as feedback in the direct feedback group only. The scenario included a 6-year-old girl being interviewed about alleged physical abuse. After the first interview session (baseline), all participants watched a video lecture on memory, witness psychology, and questioning before they conducted two additional interview sessions and completed a post-experience survey. One week later, they conducted a fourth interview and completed another post-experience survey. All chatbot transcripts were coded for interview quality. The language model’s automatic feedback function was found to be highly reliable in classifying question types, reflecting the substantial agreement among the raters [Cohen’s kappa (κ) = 0.80] in coding open-ended, cued recall, and closed questions. Participants who received direct feedback showed a significantly higher improvement in open-ended questioning than those in the non-feedback group, with a significant increase in the number of open-ended questions used between the baseline and each of the other three chat sessions. This study demonstrates that child avatar chatbot training improves interview quality with regard to recommended questioning, especially when combined with direct feedback on questioning.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligenceautomatized feedbackchatbot avatarchild abuseinvestigative interviewingtraining

Autor:innen und Institutionen

  • Department of Social Work, Child Welfare and Social Policy, Faculty of Social Science, Oslo Metropolitan University, Oslo, Norway.
  • Department of Computer Science, Faculty of Technology, Art and Design, Oslo Metropolitan University, Oslo, Norway.
  • Simula Metropolitan Center for Digital Engineering, Oslo, Norway.
  • Center for Investigative Interviewing, Griffith Criminology Institute, Griffith University, Brisbane, QLD, Australia.
  • Department of Behavioral Science, Faculty of Health Science, Oslo Metropolitan University, Oslo, Norway.

Zitieren

APA

Røed, R. K., Baugerud, G. A., Hassan, S. Z., Sabet, S. S., Salehi, P., Powell, M. B., Riegler, M. A., Halvorsen, P., & Johnson, M. S. (2023). Enhancing questioning skills through child avatar chatbot training with feedback. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1198235

Vancouver

Røed RK, Baugerud GA, Hassan SZ, Sabet SS, Salehi P, Powell MB, et al. Enhancing questioning skills through child avatar chatbot training with feedback. Frontiers in Psychology. 2023;14. doi:10.3389/fpsyg.2023.1198235

BibTeX
@article{Red2023,
  author = {Røed, Ragnhild Klingenberg and Baugerud, Gunn Astrid and Hassan, Syed Zohaib and Sabet, Saeed S and Salehi, Pegah and Powell, Martine B and Riegler, Michael A and Halvorsen, Pål and Johnson, Miriam S},
  title = {Enhancing questioning skills through child avatar chatbot training with feedback},
  journal = {Frontiers in Psychology},
  year = {2023},
  volume = {14},
  doi = {10.3389/fpsyg.2023.1198235}
}
Kostenlos starten →