EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

Autism Spectrum Disorder Detection Using Skeleton-Based Body Movement Analysis via Dual-Stream Deep Learning

Jungpil Shin, Abu Saleh Musa Miah, Manato Kakizaki, Najmul Hassan, Yoichi Tomioka

Electronics · 2025-05-30 · 14 (11) · 2231

DOI: 10.3390/electronics14112231 ↗

At a glance

Journal article in Electronics, published online on 2025-05-30. Written by Jungpil Shin and 4 co-authors. Cited 20 times so far (Crossref); 27 references. The full text is freely available (open access, CC BY 4.0). Funded by: Competitive Research Fund of The University of Aizu, Japan.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Autism Spectrum Disorder (ASD) poses significant challenges in diagnosis due to its diverse symptomatology and the complexity of early detection. Atypical gait and gesture patterns, prominent behavioural markers of ASD, hold immense potential for facilitating early intervention and optimising treatment outcomes. These patterns can be efficiently and non-intrusively captured using modern computational techniques, making them valuable for ASD recognition. Various types of research have been conducted to detect ASD through deep learning, including facial feature analysis, eye gaze analysis, and movement and gesture analysis. In this study, we optimise a dual-stream architecture that combines image classification and skeleton recognition models to analyse video data for body motion analysis. The first stream processes Skepxels—spatial representations derived from skeleton data—using ConvNeXt-Base, a robust image recognition model that efficiently captures aggregated spatial embeddings. The second stream encodes angular features, embedding relative joint angles into the skeleton sequence and extracting spatiotemporal dynamics using Multi-Scale Graph 3D Convolutional Network(MSG3D), a combination of Graph Convolutional Networks (GCNs) and Temporal Convolutional Networks (TCNs). We replace the ViT model from the original architecture with ConvNeXt-Base to evaluate the efficacy of CNN-based models in capturing gesture-related features for ASD detection. Additionally, we experimented with a Stack Transformer in the second stream instead of MSG3D but found it to result in lower performance accuracy, thus highlighting the importance of GCN-based models for motion analysis. The integration of these two streams ensures comprehensive feature extraction, capturing both global and detailed motion patterns. A pairwise Euclidean distance loss is employed during training to enhance the consistency and robustness of feature representations. The results from our experiments demonstrate that the two-stream approach, combining ConvNeXt-Base and MSG3D, offers a promising method for effective autism detection. This approach not only enhances accuracy but also contributes valuable insights into optimising deep learning models for gesture-based recognition. By integrating image classification and skeleton recognition, we can better capture both global and detailed motion patterns, which are crucial for improving early ASD diagnosis and intervention strategies.

Funding

  • Competitive Research Fund of The University of Aizu, Japan

Cite

APA

Shin, J., Miah, A. S. M., Kakizaki, M., Hassan, N., & Tomioka, Y. (2025). Autism Spectrum Disorder Detection Using Skeleton-Based Body Movement Analysis via Dual-Stream Deep Learning. Electronics, 14(11), 2231. https://doi.org/10.3390/electronics14112231

Vancouver

Shin J, Miah ASM, Kakizaki M, Hassan N, Tomioka Y. Autism Spectrum Disorder Detection Using Skeleton-Based Body Movement Analysis via Dual-Stream Deep Learning. Electronics. 2025;14(11):2231. doi:10.3390/electronics14112231

BibTeX
@article{Shin2025,
  author = {Shin, Jungpil and Miah, Abu Saleh Musa and Kakizaki, Manato and Hassan, Najmul and Tomioka, Yoichi},
  title = {Autism Spectrum Disorder Detection Using Skeleton-Based Body Movement Analysis via Dual-Stream Deep Learning},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {11},
  pages = {2231},
  doi = {10.3390/electronics14112231}
}
Start for free →