EUVIMEDOpdag EUVIMED
Systematische ÜbersichtOpen access

Innovations in Deaf Health Care Communication: Systematic Review of Sign Language Recognition Systems

Milena Soriano Marcolino, Lucca Fagundes Ramos de Oliveira, Lucas Rocha Valle, Luiza Marinho Motta Santa Rosa, Gabriela Teodora de Souza Sanches, Natalia Sales Santos, Michelle Ralil da Costa, Elidea Lucia Almeida Bernardino, Raniere Alislan Almeida Cordeiro, Raquel Oliveira Prates, Zilma Silveira Nogueira Reis, Mario Fernando Montenegro Campos

Journal of Medical Internet Research · 2026-04-09 · 28 · e70417-e70417

DOI: 10.2196/70417 ↗

At a glance

Systematische Übersicht in Journal of Medical Internet Research, published online on 2026-04-09. Written by Milena Soriano Marcolino and 11 co-authors. Institution: Medical School, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil. Major MEDLINE topics: Sign Language, Communication, Deafness, Persons with Hearing Disabilities. Cited 3 times so far (Crossref); 64 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Deaf individuals often face communication challenges when interacting with those who can hear. Within health care settings, these challenges may pose risks to their safety, potentially resulting in misdiagnoses, treatment errors, and decreased quality of care.

Objective

This study aims to systematically review the evidence on communication systems reported in the literature that use human-computer interaction techniques to support communication between deaf individuals who use sign language and hearing health professionals in health care settings. The review focuses on systems that are either currently in use or proposed for use in health care and that have been tested using human participants or videos of human users.

Methods

A comprehensive search was performed via MEDLINE, Web of Science, ACM, IEEE Xplore, Scopus, and Google Scholar in March 2025. The inclusion criteria comprised studies developing a sign language recognition system within a health care context and testing with human users. Eligible studies underwent screening by 2 independent investigators (LRV and LMMSR or LFRdO and GTdSS), with any disagreements resolved by a senior researcher (MSM).

Results

The search retrieved 21,778 publications, and screening of reference lists identified 2 additional studies, resulting in a total of 23 studies meeting the eligibility criteria. Most systems (15/23, 65.2%) were image-based, while 34.8% (8/23) relied on sensors (glove-based or depth-sensing). Applications varied across health care settings, including general hospital care (10/23, 43.5%), emergencies (8/23, 34.8%), and primary care (4/23, 17.4%). All systems were in the development and testing stage, with no data on security and psychological impacts. Accuracy ranged from 25% to 100% for image-based and 72% to 99.7% for sensor-based systems. Bidirectionality and facial expression recognition, crucial for effective communication, were largely overlooked.

Conclusions

Image-based systems were more common than sensor-based ones, though both showed wide variability in accuracy in recognizing and interpreting signs. Most systems failed to address critical aspects such as bidirectional communication and the recognition of facial expressions, essential for effective communication. None fully addresses the requirements for integration into health care settings. These findings highlight the need for further research on implementation, usability, and impact on the quality of care for deaf patients.

Subjects

MeSH terms (MEDLINE)

Sign LanguageCommunicationDeafnessPersons with Hearing DisabilitiesHumansDelivery of Health Care

Author keywords

PRISMAPreferred Reporting Items for Systematic Reviews and Meta-Analysesartificial intelligencebiomedical technologycommunication barrierscomputer neural networkdeafnessgestureshearing losssign language

Authors and institutions

  • Medical School, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil.
  • Telehealth Center, University Hospital, Universidade Federal de Minas Gerais, Avenida Professor Alfredo Balena, 190, Santa Efigênia, Belo Horizonte, CEP 30130-100, Brazil, +55 31 3307 9201.
  • Institute for Health Technology Assessment, Porto Alegre, Brazil.
  • Medical School, Universidade Federal de Ouro Preto, Ouro Preto, Brazil.
  • Faculdade de Ciências Médicas de Minas Gerais, Belo Horizonte, Brazil.
  • Department of Computer Science, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil.

Cite

APA

Marcolino, M. S., Oliveira, L. F. R., Valle, L. R., Rosa, L. M. M. S., Sanches, G. T. S., Santos, N. S., Costa, M. R. D., Bernardino, E. L. A., Cordeiro, R. A. A., Prates, R. O., Reis, Z. S. N., & Campos, M. F. M. (2026). Innovations in Deaf Health Care Communication: Systematic Review of Sign Language Recognition Systems. Journal of Medical Internet Research, 28, e70417-e70417. https://doi.org/10.2196/70417

Vancouver

Marcolino MS, Oliveira LFR, Valle LR, Rosa LMMS, Sanches GTS, Santos NS, et al. Innovations in Deaf Health Care Communication: Systematic Review of Sign Language Recognition Systems. Journal of Medical Internet Research. 2026;28:e70417-e70417. doi:10.2196/70417

BibTeX
@article{Marcolino2026,
  author = {Marcolino, Milena Soriano and Oliveira, Lucca Fagundes Ramos de and Valle, Lucas Rocha and Rosa, Luiza Marinho Motta Santa and Sanches, Gabriela Teodora de Souza and Santos, Natalia Sales and Costa, Michelle Ralil da and Bernardino, Elidea Lucia Almeida and Cordeiro, Raniere Alislan Almeida and Prates, Raquel Oliveira and Reis, Zilma Silveira Nogueira and Campos, Mario Fernando Montenegro},
  title = {Innovations in Deaf Health Care Communication: Systematic Review of Sign Language Recognition Systems},
  journal = {Journal of Medical Internet Research},
  year = {2026},
  volume = {28},
  pages = {e70417--e70417},
  doi = {10.2196/70417}
}
Start for free →