EUVIMEDOpdag EUVIMED
Open access

The Rapid Online Cognitive Assessment for the Detection of Neurocognitive Disorder: Open-Label Study

Calvin Howard iD, Amy Johnson iD, Joseph Peedicail iD, Marcus C Ng iD

Journal of Medical Internet Research · 2025

DOI: 10.2196/66735 ↗

At a glance

Journal article in Journal of Medical Internet Research, 2025. Written by Calvin Howard and 3 co-authors. Institution: Department of Neurology, Brigham and Women's Hospital, Harvard Medical School, 60 Fenwood Road 1st Floor, Boston, MA, 02115, United States. Major MEDLINE topics: Neurocognitive Disorders, Internet. Cited 1 times so far (Crossref); 55 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

The rising prevalence of dementia necessitates a scalable solution to cognitive screening. Paper-based cognitive screening examinations are well-validated but minimally scalable. If a digital cognitive screening examination could replicate paper-based screening, it may improve scalability while potentially maintaining the performance of these well-validated paper-based tests. Here, we evaluate the Rapid Online Cognitive Assessment (RoCA), a remote and self-administered digital cognitive screening examination.

Objective

The objective of this study was to validate the ability of RoCA to reliably evaluate patient input, identify patients with cognitive impairment relative to the established tests, and evaluate its potential as a screening tool.

Methods

RoCA uses a convolutional neural network to evaluate a patient’s ability to perform common cognitive screening tasks: wireframe diagram copying and clock drawing tests. To evaluate RoCA, we compared its evaluations with those of established paper-based tests. This open-label study consists of 46 patients (age range 33-82 years) who were enrolled from neurology clinics. Patients completed the RoCA screening examination and either Addenbrooke’s Cognitive Examination-3 (ACE-3, n=35) or Montreal Cognitive Assessment (MoCA, n=11). We evaluated 3 primary metrics of RoCA’s performance: (1) ability to correctly evaluate patient inputs, (2) ability to identify patients with cognitive impairment compared to ACE-3 and MoCA, and (3) performance as a screening tool.

Results

RoCA classifies patients similarly to gold standard paper-based tests, with a receiver operating characteristic area under the curve of 0.81 (95% CI 0.67‐0.91; P

Subjects

MeSH terms (MEDLINE)

Neurocognitive DisordersInternetHumansMiddle AgedAgedMaleFemaleAdultAged, 80 and overNeuropsychological TestsNeural Networks, ComputerCognitive Dysfunction

Author keywords

Rapid Online Cognitive AssessmentRoCAartificial intelligenceassessmentcognitioncognitivecognitive assessmentcognitive examinationcohortdementiageriatricsneurologyonline assessmentremote screeningscreening

Authors and institutions

  • Department of Neurology, Brigham and Women's Hospital, Harvard Medical School, 60 Fenwood Road 1st Floor, Boston, MA, 02115, United States.
  • Section of Neurology, Department of Internal Medicine, University of Manitoba, Winnipeg, MB, R3T 2N2, Canada.
  • Klinik für Neurologie mit Experimenteller Neurologie, Charité - Universitätsmedizin Berlin, Berlin, Germany.
  • Graduate Program in Biomedical Engineering, University of Manitoba, Winnipeg, MB, Canada.

ORCID profiles: Calvin Howard, Amy Johnson, Joseph Peedicail, Marcus C Ng

Cite

APA

Howard, C., Johnson, A., Peedicail, J., & Ng, M. C. (2025). The Rapid Online Cognitive Assessment for the Detection of Neurocognitive Disorder: Open-Label Study. Journal of Medical Internet Research. https://doi.org/10.2196/66735

Vancouver

Howard C, Johnson A, Peedicail J, Ng MC. The Rapid Online Cognitive Assessment for the Detection of Neurocognitive Disorder: Open-Label Study. Journal of Medical Internet Research. 2025. doi:10.2196/66735

BibTeX
@article{Howard2025,
  author = {Howard, Calvin and Johnson, Amy and Peedicail, Joseph and Ng, Marcus C},
  title = {The Rapid Online Cognitive Assessment for the Detection of Neurocognitive Disorder: Open-Label Study},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  doi = {10.2196/66735}
}
Start for free →