EUVIMEDObjevte EUVIMED
Open access

Chatbot for Social Need Screening and Resource Sharing With Vulnerable Families: Iterative Design and Evaluation Study

Emre Sezgin iD, A Baki Kocaballi iD, Millie Dolce iD, Micah Skeens iD, Lisa Militello iD, Yungui Huang iD, Jack Stevens iD, Alex R Kemper iD

JMIR Human Factors · 2024-07-19 · 11 · e57114

DOI: 10.2196/57114 ↗

At a glance

Journal article in JMIR Human Factors, published online on 2024-07-19. Written by Emre Sezgin and 7 co-authors. Institution: Nationwide Children's Hospital, Columbus, OH, United States. Major MEDLINE topics: Vulnerable Populations. Cited 34 times so far (Crossref); 73 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

Health outcomes are significantly influenced by unmet social needs. Although screening for social needs has become common in health care settings, there is often poor linkage to resources after needs are identified. The structural barriers (eg, staffing, time, and space) to helping address social needs could be overcome by a technology-based solution.

Objective

This study aims to present the design and evaluation of a chatbot, DAPHNE (Dialog-Based Assistant Platform for Healthcare and Needs Ecosystem), which screens for social needs and links patients and families to resources.

Methods

This research used a three-stage study approach: (1) an end-user survey to understand unmet needs and perception toward chatbots, (2) iterative design with interdisciplinary stakeholder groups, and (3) a feasibility and usability assessment. In study 1, a web-based survey was conducted with low-income US resident households (n=201). Following that, in study 2, web-based sessions were held with an interdisciplinary group of stakeholders (n=10) using thematic and content analysis to inform the chatbot’s design and development. Finally, in study 3, the assessment on feasibility and usability was completed via a mix of a web-based survey and focus group interviews following scenario-based usability testing with community health workers (family advocates; n=4) and social workers (n=9). We reported descriptive statistics and chi-square test results for the household survey. Content analysis and thematic analysis were used to analyze qualitative data. Usability score was descriptively reported.

Results

Among the survey participants, employed and younger individuals reported a higher likelihood of using a chatbot to address social needs, in contrast to the oldest age group. Regarding designing the chatbot, the stakeholders emphasized the importance of provider-technology collaboration, inclusive conversational design, and user education. The participants found that the chatbot’s capabilities met expectations and that the chatbot was easy to use (System Usability Scale score=72/100). However, there were common concerns about the accuracy of suggested resources, electronic health record integration, and trust with a chatbot.

Conclusions

Chatbots can provide personalized feedback for families to identify and meet social needs. Our study highlights the importance of user-centered iterative design and development of chatbots for social needs. Future research should examine the efficacy, cost-effectiveness, and scalability of chatbot interventions to address social needs.

Subjects

MeSH terms (MEDLINE)

Vulnerable PopulationsHumansSurveys and QuestionnairesFemaleNeeds AssessmentAdultMaleFocus GroupsMiddle Aged

Author keywords

chatbotconversational agentdigital healthevaluationfeasibilityimplementationiterative designprimary caresocial determinants of healthsocial needsusability

Authors and institutions

  • Nationwide Children's Hospital, Columbus, OH, United States.
  • Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia.
  • The Ohio State University, Columbus, OH, United States.

ORCID profiles: Emre Sezgin, A Baki Kocaballi, Millie Dolce, Micah Skeens, Lisa Militello, Yungui Huang, Jack Stevens, Alex R Kemper

Cite

APA

Sezgin, E., Kocaballi, A. B., Dolce, M., Skeens, M., Militello, L., Huang, Y., Stevens, J., & Kemper, A. R. (2024). Chatbot for Social Need Screening and Resource Sharing With Vulnerable Families: Iterative Design and Evaluation Study. JMIR Human Factors, 11, e57114. https://doi.org/10.2196/57114

Vancouver

Sezgin E, Kocaballi AB, Dolce M, Skeens M, Militello L, Huang Y, et al. Chatbot for Social Need Screening and Resource Sharing With Vulnerable Families: Iterative Design and Evaluation Study. JMIR Human Factors. 2024;11:e57114. doi:10.2196/57114

BibTeX
@article{Sezgin2024,
  author = {Sezgin, Emre and Kocaballi, A Baki and Dolce, Millie and Skeens, Micah and Militello, Lisa and Huang, Yungui and Stevens, Jack and Kemper, Alex R},
  title = {Chatbot for Social Need Screening and Resource Sharing With Vulnerable Families: Iterative Design and Evaluation Study},
  journal = {JMIR Human Factors},
  year = {2024},
  volume = {11},
  pages = {e57114},
  doi = {10.2196/57114}
}
Start for free →