An Entropy-Based Clustering Algorithm for Real-Time High-Dimensional IoT Data Streams
Sensors · 20.11.2024 · 24 (22) · 7412
DOI: 10.3390/s24227412 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 20.11.2024. Verfasst von Ibrahim Mutambik. Beteiligte Einrichtung: Department of Information Science, College of Humanities and Social Sciences, King Saud University, P.O. Box 11451, Riyadh 4545, Saudi Arabia. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Researchers Supporting Project (RSP2024R233), King Saud University, Riyadh, Saudi Arabia, King Saud University.
Abstract (Originalsprache)
The rapid growth of data streams, propelled by the proliferation of sensors and Internet of Things (IoT) devices, presents significant challenges for real-time clustering of high-dimensional data. Traditional clustering algorithms struggle with high dimensionality, memory and time constraints, and adapting to dynamically evolving data. Existing dimensionality reduction methods often neglect feature ranking, leading to suboptimal clustering performance. To address these issues, we introduce E-Stream, a novel entropy-based clustering algorithm for high-dimensional data streams. E-Stream performs real-time feature ranking based on entropy within a sliding time window to identify the most informative features, which are then utilized with the DenStream algorithm for efficient clustering. We evaluated E-Stream using the NSL-KDD dataset, comparing it against DenStream, CluStream, and MR-Stream. The evaluation metrics included the average F-Measure, Jaccard Index, Fowlkes–Mallows Index, Purity, and Rand Index. The results show that E-Stream outperformed the baseline algorithms in both clustering accuracy and computational efficiency while effectively reducing dimensionality. E-Stream also demonstrated significantly less memory consumption and fewer computational requirements, highlighting its suitability for real-time processing of high-dimensional data streams. Despite its strengths, E-Stream requires manual parameter adjustment and assumes a consistent number of active features, which may limit its adaptability to diverse datasets. Future work will focus on developing a fully autonomous, parameter-free version of the algorithm, incorporating mechanisms to handle missing features and improving the management of evolving clusters to enhance robustness and adaptability in dynamic IoT environments.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Information Science, College of Humanities and Social Sciences, King Saud University, P.O. Box 11451, Riyadh 4545, Saudi Arabia.
ORCID-Profile: Ibrahim Mutambik
Förderung
- Researchers Supporting Project (RSP2024R233), King Saud University, Riyadh, Saudi Arabia
- King Saud University
Zitieren
APA
Mutambik, I. (2024). An Entropy-Based Clustering Algorithm for Real-Time High-Dimensional IoT Data Streams. Sensors, 24(22), 7412. https://doi.org/10.3390/s24227412
Vancouver
Mutambik I. An Entropy-Based Clustering Algorithm for Real-Time High-Dimensional IoT Data Streams. Sensors. 2024;24(22):7412. doi:10.3390/s24227412
BibTeX
@article{Mutambik2024,
author = {Mutambik, Ibrahim},
title = {An Entropy-Based Clustering Algorithm for Real-Time High-Dimensional IoT Data Streams},
journal = {Sensors},
year = {2024},
volume = {24},
number = {22},
pages = {7412},
doi = {10.3390/s24227412}
}
EUVIMED