EUVIMEDEUVIMED entdecken
Open Access

A Motivational Interviewing Chatbot With Generative Reflections for Increasing Readiness to Quit Smoking: Iterative Development Study

Andrew Brown iD, Ash Tanuj Kumar iD, Osnat Melamed iD, Imtihan Ahmed iD, Yu Hao Wang iD, Arnaud Deza iD, Marc Morcos iD, Leon Zhu iD, Marta Maslej iD, Nadia Minian iD, Vidya Sujaya iD, Jodi Wolff iD und 5 weitere

JMIR Mental Health · 17.10.2023 · 10 · e49132

DOI: 10.2196/49132 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR Mental Health, online erschienen am 17.10.2023. Verfasst von Andrew Brown und 16 weiteren Autor:innen. Beteiligte Einrichtung: The Edward S Rogers Sr Department of Electrical & Computer Engineering, University of Toronto, Toronto, ON, Canada. Die Arbeit wurde bisher 51-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The motivational interviewing (MI) approach has been shown to help move ambivalent smokers toward the decision to quit smoking. There have been several attempts to broaden access to MI through text-based chatbots. These typically use scripted responses to client statements, but such nonspecific responses have been shown to reduce effectiveness. Recent advances in natural language processing provide a new way to create responses that are specific to a client’s statements, using a generative language model.

Objective

This study aimed to design, evolve, and measure the effectiveness of a chatbot system that can guide ambivalent people who smoke toward the decision to quit smoking with MI-style generative reflections.

Methods

Over time, 4 different MI chatbot versions were evolved, and each version was tested with a separate group of ambivalent smokers. A total of 349 smokers were recruited through a web-based recruitment platform. The first chatbot version only asked questions without reflections on the answers. The second version asked the questions and provided reflections with an initial version of the reflection generator. The third version used an improved reflection generator, and the fourth version added extended interaction on some of the questions. Participants’ readiness to quit was measured before the conversation and 1 week later using an 11-point scale that measured 3 attributes related to smoking cessation: readiness, confidence, and importance. The number of quit attempts made in the week before the conversation and the week after was surveyed; in addition, participants rated the perceived empathy of the chatbot. The main body of the conversation consists of 5 scripted questions, responses from participants, and (for 3 of the 4 versions) generated reflections. A pretrained transformer-based neural network was fine-tuned on examples of high-quality reflections to generate MI reflections.

Results

The increase in average confidence using the nongenerative version was 1.0 (SD 2.0; P=.001), whereas for the 3 generative versions, the increases ranged from 1.2 to 1.3 (SD 2.0-2.3; P

Schlagwörter

Stichwörter der Autor:innen

AIartificial intelligencebehavior changechatbotsconversational agentsdeep learninggenerative artificial intelligencemotivational interviewingnatural language processingsmoking cessationtransformers

Autor:innen und Institutionen

  • The Edward S Rogers Sr Department of Electrical & Computer Engineering, University of Toronto, Toronto, ON, Canada.
  • INTREPID Lab, Centre for Addiction and Mental Health, Toronto, ON, Canada.
  • Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada.
  • Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada.
  • Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, ON, Canada.
  • Department of Pharmacology and Toxicology, University of Toronto, Toronto, ON, Canada.

ORCID-Profile: Andrew Brown, Ash Tanuj Kumar, Osnat Melamed, Imtihan Ahmed, Yu Hao Wang, Arnaud Deza, Marc Morcos, Leon Zhu, Marta Maslej, Nadia Minian, Vidya Sujaya, Jodi Wolff, Olivia Doggett, Mathew Iantorno, Matt Ratto, Peter Selby, Jonathan Rose

Zitieren

APA

Brown, A., Kumar, A. T., Melamed, O., Ahmed, I., Wang, Y. H., Deza, A., Morcos, M., Zhu, L., Maslej, M., Minian, N., Sujaya, V., Wolff, J., Doggett, O., Iantorno, M., Ratto, M., Selby, P., & Rose, J. (2023). A Motivational Interviewing Chatbot With Generative Reflections for Increasing Readiness to Quit Smoking: Iterative Development Study. JMIR Mental Health, 10, e49132. https://doi.org/10.2196/49132

Vancouver

Brown A, Kumar AT, Melamed O, Ahmed I, Wang YH, Deza A, et al. A Motivational Interviewing Chatbot With Generative Reflections for Increasing Readiness to Quit Smoking: Iterative Development Study. JMIR Mental Health. 2023;10:e49132. doi:10.2196/49132

BibTeX
@article{Brown2023,
  author = {Brown, Andrew and Kumar, Ash Tanuj and Melamed, Osnat and Ahmed, Imtihan and Wang, Yu Hao and Deza, Arnaud and Morcos, Marc and Zhu, Leon and Maslej, Marta and Minian, Nadia and Sujaya, Vidya and Wolff, Jodi and Doggett, Olivia and Iantorno, Mathew and Ratto, Matt and Selby, Peter and Rose, Jonathan},
  title = {A Motivational Interviewing Chatbot With Generative Reflections for Increasing Readiness to Quit Smoking: Iterative Development Study},
  journal = {JMIR Mental Health},
  year = {2023},
  volume = {10},
  pages = {e49132},
  doi = {10.2196/49132}
}
Kostenlos starten →