EUVIMEDEUVIMED entdecken
Open Access

Combination of Paper and Electronic Trail Making Tests for Automatic Analysis of Cognitive Impairment: Development and Validation Study

Wei Zhang iD, Xiaoran Zheng iD, Zeshen Tang iD, Haoran Wang iD, Renren Li iD, Zengmai Xie iD, Jiaxin Yan iD, Xiaochen Zhang iD, Qing Yu iD, Fei Wang iD, Yunxia Li iD

Journal of Medical Internet Research · 09.06.2023 · 25 · e42637

DOI: 10.2196/42637 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Medical Internet Research, online erschienen am 09.06.2023. Verfasst von Wei Zhang und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Neurology, Tongji Hospital, School of Medicine, Tongji University, Shanghai, China. Hauptthemen laut MEDLINE: Cognitive Dysfunction, Alzheimer Disease. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Computer-aided detection, used in the screening and diagnosing of cognitive impairment, provides an objective, valid, and convenient assessment. Particularly, digital sensor technology is a promising detection method.

Objective

This study aimed to develop and validate a novel Trail Making Test (TMT) using a combination of paper and electronic devices.

Methods

This study included community-dwelling older adult individuals (n=297), who were classified into (1) cognitively healthy controls (HC; n=100 participants), (2) participants diagnosed with mild cognitive impairment (MCI; n=98 participants), and (3) participants with Alzheimer disease (AD; n=99 participants). An electromagnetic tablet was used to record each participant’s hand-drawn stroke. A sheet of A4 paper was placed on top of the tablet to maintain the traditional interaction style for participants who were not familiar or comfortable with electronic devices (such as touchscreens). In this way, all participants were instructed to perform the TMT-square and circle. Furthermore, we developed an efficient and interpretable cognitive impairment–screening model to automatically analyze cognitive impairment levels that were dependent on demographic characteristics and time-, pressure-, jerk-, and template-related features. Among these features, novel template-based features were based on a vector quantization algorithm. First, the model identified a candidate trajectory as the standard answer (template) from the HC group. The distance between the recorded trajectories and reference was computed as an important evaluation index. To verify the effectiveness of our method, we compared the performance of a well-trained machine learning model using the extracted evaluation index with conventional demographic characteristics and time-related features. The well-trained model was validated using follow-up data (HC group: n=38; MCI group: n=32; and AD group: n=22).

Results

We compared 5 candidate machine learning methods and selected random forest as the ideal model with the best performance (accuracy: 0.726 for HC vs MCI, 0.929 for HC vs AD, and 0.815 for AD vs MCI). Meanwhile, the well-trained classifier achieved better performance than the conventional assessment method, with high stability and accuracy of the follow-up data.

Conclusions

The study demonstrated that a model combining both paper and electronic TMTs increases the accuracy of evaluating participants’ cognitive impairment compared to conventional paper-based feature assessment.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Cognitive DysfunctionAlzheimer DiseaseHumansAgedTrail Making TestMagnetic Resonance ImagingElectronics

Stichwörter der Autor:innen

Trail Making Testcognition impairmentmixed modepaper and electronic devicesscreeningvector quantization

Autor:innen und Institutionen

  • Department of Neurology, Tongji Hospital, School of Medicine, Tongji University, Shanghai, China.
  • Department of Computer Science and Technolgy, College of Electronic and Information Engineering, Tongji University, Shanghai, China.
  • Department of Neurosurgery, Tongji Hospital, School of Medicine, Tongji University, Shanghai, China.

ORCID-Profile: Wei Zhang, Xiaoran Zheng, Zeshen Tang, Haoran Wang, Renren Li, Zengmai Xie, Jiaxin Yan, Xiaochen Zhang, Qing Yu, Fei Wang, Yunxia Li

Zitieren

APA

Zhang, W., Zheng, X., Tang, Z., Wang, H., Li, R., Xie, Z., Yan, J., Zhang, X., Yu, Q., Wang, F., & Li, Y. (2023). Combination of Paper and Electronic Trail Making Tests for Automatic Analysis of Cognitive Impairment: Development and Validation Study. Journal of Medical Internet Research, 25, e42637. https://doi.org/10.2196/42637

Vancouver

Zhang W, Zheng X, Tang Z, Wang H, Li R, Xie Z, et al. Combination of Paper and Electronic Trail Making Tests for Automatic Analysis of Cognitive Impairment: Development and Validation Study. Journal of Medical Internet Research. 2023;25:e42637. doi:10.2196/42637

BibTeX
@article{Zhang2023,
  author = {Zhang, Wei and Zheng, Xiaoran and Tang, Zeshen and Wang, Haoran and Li, Renren and Xie, Zengmai and Yan, Jiaxin and Zhang, Xiaochen and Yu, Qing and Wang, Fei and Li, Yunxia},
  title = {Combination of Paper and Electronic Trail Making Tests for Automatic Analysis of Cognitive Impairment: Development and Validation Study},
  journal = {Journal of Medical Internet Research},
  year = {2023},
  volume = {25},
  pages = {e42637},
  doi = {10.2196/42637}
}
Kostenlos starten →