EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep learning-driven dyslexia detection model using multi-modality data

Yazeed Alkhurayyif, Abdul Rahaman Wahab Sait

PeerJ Computer Science · 14.06.2024 · 10 · e2077

DOI: 10.7717/peerj-cs.2077 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 14.06.2024. Verfasst von Yazeed Alkhurayyif und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, Shaqra University, Shaqra, Saudi Arabia. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: The King Salman Center for Disability Research.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Dyslexia is a neurological disorder that affects an individual’s language processing abilities. Early care and intervention can help dyslexic individuals succeed academically and socially. Recent developments in deep learning (DL) approaches motivate researchers to build dyslexia detection models (DDMs). DL approaches facilitate the integration of multi-modality data. However, there are few multi-modality-based DDMs.

Methods

In this study, the authors built a DL-based DDM using multi-modality data. A squeeze and excitation (SE) integrated MobileNet V3 model, self-attention mechanisms (SA) based EfficientNet B7 model, and early stopping and SA-based Bi-directional long short-term memory (Bi-LSTM) models were developed to extract features from magnetic resonance imaging (MRI), functional MRI, and electroencephalography (EEG) data. In addition, the authors fine-tuned the LightGBM model using the Hyperband optimization technique to detect dyslexia using the extracted features. Three datasets containing FMRI, MRI, and EEG data were used to evaluate the performance of the proposed DDM.

Results

The findings supported the significance of the proposed DDM in detecting dyslexia with limited computational resources. The proposed model outperformed the existing DDMs by producing an optimal accuracy of 98.9%, 98.6%, and 98.8% for the FMRI, MRI, and EEG datasets, respectively. Healthcare centers and educational institutions can benefit from the proposed model to identify dyslexia in the initial stages. The interpretability of the proposed model can be improved by integrating vision transformers-based feature extraction.

Schlagwörter

Stichwörter der Autor:innen

Convolutional neural networkDeep learningDyslexiaFeature extractionFunctional MRIMulti-modality dataWearable EEG device

Autor:innen und Institutionen

  • Department of Computer Science, Shaqra University, Shaqra, Saudi Arabia.
  • Department of Documents and Archive, Center of Documents and Administrative Communication, King Faisal University, Al-Ahsa, Saudi Arabia.

Förderung

  • The King Salman Center for Disability Research

Zitieren

APA

Alkhurayyif, Y., & Wahab Sait, A. R. (2024). Deep learning-driven dyslexia detection model using multi-modality data. PeerJ Computer Science, 10, e2077. https://doi.org/10.7717/peerj-cs.2077

Vancouver

Alkhurayyif Y, Wahab Sait AR. Deep learning-driven dyslexia detection model using multi-modality data. PeerJ Computer Science. 2024;10:e2077. doi:10.7717/peerj-cs.2077

BibTeX
@article{Alkhurayyif2024,
  author = {Alkhurayyif, Yazeed and Wahab Sait, Abdul Rahaman},
  title = {Deep learning-driven dyslexia detection model using multi-modality data},
  journal = {PeerJ Computer Science},
  year = {2024},
  volume = {10},
  pages = {e2077},
  doi = {10.7717/peerj-cs.2077}
}
Kostenlos starten →