Smartic: A smart tool for Big Data analytics and IoT
F1000Research · 2024
DOI: 10.12688/f1000research.73613.2 ↗Kurz gefasst
Fachartikel in der Zeitschrift F1000Research, 2024. Verfasst von Shohel Sayeed und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Information Science and Technology, Multimedia University, Melaka, Melaka, 75450, Malaysia. Hauptthemen laut MEDLINE: Big Data, Internet of Things, Software. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Multimedia University.
Abstract (Originalsprache)
The Internet of Things (IoT) is leading the physical and digital world of technology to converge. Real-time and massive scale connections produce a large amount of versatile data, where Big Data comes into the picture. Big Data refers to large, diverse sets of information with dimensions that go beyond the capabilities of widely used database management systems, or standard data processing software tools to manage within a given limit. Almost every big dataset is dirty and may contain missing data, mistyping, inaccuracies, and many more issues that impact Big Data analytics performances. One of the biggest challenges in Big Data analytics is to discover and repair dirty data; failure to do this can lead to inaccurate analytics results and unpredictable conclusions. Different imputation methods were employed in the experimentation with various missing value imputation techniques, and the performances of machine learning (ML) models were compared. A hybrid model that integrates ML and sample-based statistical techniques for missing value imputation is being proposed. Furthermore, the continuation involved the dataset with the best missing value imputation, chosen based on ML model performance for subsequent feature engineering and hyperparameter tuning. K-means clustering and principal component analysis were applied in our study. Accuracy, the evaluated outcome, improved dramatically and proved that the XGBoost model gives very high accuracy at around 0.125 root mean squared logarithmic error (RMSLE). To overcome overfitting, K-fold cross-validation was implemented.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Information Science and Technology, Multimedia University, Melaka, Melaka, 75450, Malaysia.
ORCID-Profile: Shohel Sayeed, Tan Choo Peng
Förderung
- Multimedia University
Zitieren
APA
Sayeed, S., Ahmad, A. F., & Peng, T. C. (2024). Smartic: A smart tool for Big Data analytics and IoT. F1000Research. https://doi.org/10.12688/f1000research.73613.2
Vancouver
Sayeed S, Ahmad AF, Peng TC. Smartic: A smart tool for Big Data analytics and IoT. F1000Research. 2024. doi:10.12688/f1000research.73613.2
BibTeX
@article{Sayeed2024,
author = {Sayeed, Shohel and Ahmad, Abu Fuad and Peng, Tan Choo},
title = {Smartic: A smart tool for Big Data analytics and IoT},
journal = {F1000Research},
year = {2024},
doi = {10.12688/f1000research.73613.2}
}
EUVIMED