EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Smartic: A smart tool for Big Data analytics and IoT

Shohel Sayeed iD, Abu Fuad Ahmad, Tan Choo Peng iD

F1000Research · 2024

DOI: 10.12688/f1000research.73613.2 ↗

Kurz gefasst

Fachartikel in der Zeitschrift F1000Research, 2024. Verfasst von Shohel Sayeed und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Information Science and Technology, Multimedia University, Melaka, Melaka, 75450, Malaysia. Hauptthemen laut MEDLINE: Big Data, Internet of Things, Software. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Multimedia University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The Internet of Things (IoT) is leading the physical and digital world of technology to converge. Real-time and massive scale connections produce a large amount of versatile data, where Big Data comes into the picture. Big Data refers to large, diverse sets of information with dimensions that go beyond the capabilities of widely used database management systems, or standard data processing software tools to manage within a given limit. Almost every big dataset is dirty and may contain missing data, mistyping, inaccuracies, and many more issues that impact Big Data analytics performances. One of the biggest challenges in Big Data analytics is to discover and repair dirty data; failure to do this can lead to inaccurate analytics results and unpredictable conclusions. Different imputation methods were employed in the experimentation with various missing value imputation techniques, and the performances of machine learning (ML) models were compared. A hybrid model that integrates ML and sample-based statistical techniques for missing value imputation is being proposed. Furthermore, the continuation involved the dataset with the best missing value imputation, chosen based on ML model performance for subsequent feature engineering and hyperparameter tuning. K-means clustering and principal component analysis were applied in our study. Accuracy, the evaluated outcome, improved dramatically and proved that the XGBoost model gives very high accuracy at around 0.125 root mean squared logarithmic error (RMSLE). To overcome overfitting, K-fold cross-validation was implemented.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Big DataInternet of ThingsSoftwareMachine LearningHumansPrincipal Component AnalysisData Analytics

Stichwörter der Autor:innen

Big Data AnalyticsData CleaningData ImputationFeature EngineeringIoT

Autor:innen und Institutionen

  • Faculty of Information Science and Technology, Multimedia University, Melaka, Melaka, 75450, Malaysia.

ORCID-Profile: Shohel Sayeed, Tan Choo Peng

Förderung

  • Multimedia University

Zitieren

APA

Sayeed, S., Ahmad, A. F., & Peng, T. C. (2024). Smartic: A smart tool for Big Data analytics and IoT. F1000Research. https://doi.org/10.12688/f1000research.73613.2

Vancouver

Sayeed S, Ahmad AF, Peng TC. Smartic: A smart tool for Big Data analytics and IoT. F1000Research. 2024. doi:10.12688/f1000research.73613.2

BibTeX
@article{Sayeed2024,
  author = {Sayeed, Shohel and Ahmad, Abu Fuad and Peng, Tan Choo},
  title = {Smartic: A smart tool for Big Data analytics and IoT},
  journal = {F1000Research},
  year = {2024},
  doi = {10.12688/f1000research.73613.2}
}
Kostenlos starten →