The Rapid Online Cognitive Assessment for the Detection of Neurocognitive Disorder: Open-Label Study
Journal of Medical Internet Research · 2025
DOI: 10.2196/66735 ↗At a glance
Journal article in Journal of Medical Internet Research, 2025. Written by Calvin Howard and 3 co-authors. Institution: Department of Neurology, Brigham and Women's Hospital, Harvard Medical School, 60 Fenwood Road 1st Floor, Boston, MA, 02115, United States. Major MEDLINE topics: Neurocognitive Disorders, Internet. Cited 1 times so far (Crossref); 55 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
The rising prevalence of dementia necessitates a scalable solution to cognitive screening. Paper-based cognitive screening examinations are well-validated but minimally scalable. If a digital cognitive screening examination could replicate paper-based screening, it may improve scalability while potentially maintaining the performance of these well-validated paper-based tests. Here, we evaluate the Rapid Online Cognitive Assessment (RoCA), a remote and self-administered digital cognitive screening examination.
Objective
The objective of this study was to validate the ability of RoCA to reliably evaluate patient input, identify patients with cognitive impairment relative to the established tests, and evaluate its potential as a screening tool.
Methods
RoCA uses a convolutional neural network to evaluate a patient’s ability to perform common cognitive screening tasks: wireframe diagram copying and clock drawing tests. To evaluate RoCA, we compared its evaluations with those of established paper-based tests. This open-label study consists of 46 patients (age range 33-82 years) who were enrolled from neurology clinics. Patients completed the RoCA screening examination and either Addenbrooke’s Cognitive Examination-3 (ACE-3, n=35) or Montreal Cognitive Assessment (MoCA, n=11). We evaluated 3 primary metrics of RoCA’s performance: (1) ability to correctly evaluate patient inputs, (2) ability to identify patients with cognitive impairment compared to ACE-3 and MoCA, and (3) performance as a screening tool.
Results
RoCA classifies patients similarly to gold standard paper-based tests, with a receiver operating characteristic area under the curve of 0.81 (95% CI 0.67‐0.91; P
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Neurology, Brigham and Women's Hospital, Harvard Medical School, 60 Fenwood Road 1st Floor, Boston, MA, 02115, United States.
- Section of Neurology, Department of Internal Medicine, University of Manitoba, Winnipeg, MB, R3T 2N2, Canada.
- Klinik für Neurologie mit Experimenteller Neurologie, Charité - Universitätsmedizin Berlin, Berlin, Germany.
- Graduate Program in Biomedical Engineering, University of Manitoba, Winnipeg, MB, Canada.
ORCID profiles: Calvin Howard, Amy Johnson, Joseph Peedicail, Marcus C Ng
Cite
APA
Howard, C., Johnson, A., Peedicail, J., & Ng, M. C. (2025). The Rapid Online Cognitive Assessment for the Detection of Neurocognitive Disorder: Open-Label Study. Journal of Medical Internet Research. https://doi.org/10.2196/66735
Vancouver
Howard C, Johnson A, Peedicail J, Ng MC. The Rapid Online Cognitive Assessment for the Detection of Neurocognitive Disorder: Open-Label Study. Journal of Medical Internet Research. 2025. doi:10.2196/66735
BibTeX
@article{Howard2025,
author = {Howard, Calvin and Johnson, Amy and Peedicail, Joseph and Ng, Marcus C},
title = {The Rapid Online Cognitive Assessment for the Detection of Neurocognitive Disorder: Open-Label Study},
journal = {Journal of Medical Internet Research},
year = {2025},
doi = {10.2196/66735}
}
EUVIMED