Intelligent ADL Recognition via IoT-Based Multimodal Deep Learning Framework
Sensors · 16.09.2023 · 23 (18) · 7927
DOI: 10.3390/s23187927 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 16.09.2023. Verfasst von Madiha Javeed und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, Air University, E-9, Islamabad 44000, Pakistan. Hauptthemen laut MEDLINE: Activities of Daily Living, Deep Learning, Internet of Things. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Princess Nourah bint Abdulrahman University Researchers, Deanship of Scientific Research at Najran University.
Abstract (Originalsprache)
Smart home monitoring systems via internet of things (IoT) are required for taking care of elders at home. They provide the flexibility of monitoring elders remotely for their families and caregivers. Activities of daily living are an efficient way to effectively monitor elderly people at home and patients at caregiving facilities. The monitoring of such actions depends largely on IoT-based devices, either wireless or installed at different places. This paper proposes an effective and robust layered architecture using multisensory devices to recognize the activities of daily living from anywhere. Multimodality refers to the sensory devices of multiple types working together to achieve the objective of remote monitoring. Therefore, the proposed multimodal-based approach includes IoT devices, such as wearable inertial sensors and videos recorded during daily routines, fused together. The data from these multi-sensors have to be processed through a pre-processing layer through different stages, such as data filtration, segmentation, landmark detection, and 2D stick model. In next layer called the features processing, we have extracted, fused, and optimized different features from multimodal sensors. The final layer, called classification, has been utilized to recognize the activities of daily living via a deep learning technique known as convolutional neural network. It is observed from the proposed IoT-based multimodal layered system’s results that an acceptable mean accuracy rate of 84.14% has been achieved.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Science, Air University, E-9, Islamabad 44000, Pakistan.
- Department of Computer Science, College of Computer Science and Information System, Najran University, Najran 55461, Saudi Arabia.
- Information Systems Department, Umm Al-Qura University, Makkah 24382, Saudi Arabia.
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia.
ORCID-Profile: Naif Al Mudawi, Sultan Almakdi, Saud S Alotaibi, Samia Allaoua Chelloug
Förderung
- Princess Nourah bint Abdulrahman University Researchers
- Deanship of Scientific Research at Najran University
Zitieren
APA
Javeed, M., Mudawi, N. A., Alazeb, A., Almakdi, S., Alotaibi, S. S., Chelloug, S. A., & Jalal, A. (2023). Intelligent ADL Recognition via IoT-Based Multimodal Deep Learning Framework. Sensors, 23(18), 7927. https://doi.org/10.3390/s23187927
Vancouver
Javeed M, Mudawi NA, Alazeb A, Almakdi S, Alotaibi SS, Chelloug SA, et al. Intelligent ADL Recognition via IoT-Based Multimodal Deep Learning Framework. Sensors. 2023;23(18):7927. doi:10.3390/s23187927
BibTeX
@article{Javeed2023,
author = {Javeed, Madiha and Mudawi, Naif Al and Alazeb, Abdulwahab and Almakdi, Sultan and Alotaibi, Saud S and Chelloug, Samia Allaoua and Jalal, Ahmad},
title = {Intelligent ADL Recognition via IoT-Based Multimodal Deep Learning Framework},
journal = {Sensors},
year = {2023},
volume = {23},
number = {18},
pages = {7927},
doi = {10.3390/s23187927}
}
EUVIMED