Transformer-based tokenization for IoT traffic classification across diverse network environments
PeerJ Computer Science · 15.08.2025 · 11 · e3126
DOI: 10.7717/peerj-cs.3126 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 15.08.2025. Verfasst von Firdaus Afifi und 4 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Computer Science and Mathematics, Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Konsortium Kecemerlangan Penyelidikan, Fundamental Research Grant Scheme, Ministry of Higher Education of Malaysia.
Abstract (Originalsprache)
The rapid expansion of the Internet of Things (IoT) has significantly increased the volume and diversity of network traffic, making accurate IoT traffic classification crucial for maintaining network security and efficiency. However, existing traffic classification methods, including traditional machine learning and deep learning approaches, often exhibit critical limitations, such as insufficient generalization across diverse IoT environments, dependency on extensive labelled datasets, and susceptibility to overfitting in dynamic scenarios. While recent transformer-based models show promise in capturing contextual information, they typically rely on standard tokenization, which is ill-suited for the irregular nature of IoT traffic and often remains confined to single-purpose tasks. To address these challenges, this study introduces MIND-IoT, a novel and scalable framework for classifying generalized IoT traffic. MIND-IoT employs a hybrid architecture that combines Transformer-based models for capturing long-range dependencies and convolutional neural networks (CNNs) for efficient local feature extraction. A key innovation is IoT-Tokenize, a custom tokenization pipeline designed to preserve the structural semantics of network flows by converting statistical traffic features into semantically meaningful feature-value pairs. The framework operates in two phases: a pre-training phase utilizing masked language modeling (MLM) on large-scale IoT data (UNSW IoT Traces and MonIoTr) to learn robust representations and a fine-tuning phase that adapts the model to specific classification tasks, including binary IoT vs . non-IoT classification, IoT category classification, and device identification. Comprehensive evaluation across multiple diverse datasets (IoT Sentinel, YourThings, and IoT-FCSIT, in addition to the pre-training datasets) demonstrates MIND-IoT’s superior performance, robustness, and adaptability compared to traditional methods. The model achieves an accuracy of up to 98.14% and a 97.85% F1-score, demonstrating its ability to classify new datasets and adapt to emerging tasks with minimal fine-tuning and remarkable efficiency. This research positions MIND-IoT as a highly effective and scalable solution for real-world IoT traffic classification challenges.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Computer Science and Mathematics, Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia.
- Centre of Research for Cyber Security and Network (CSNET), Faculty of Computer Science and Information Technology, Universiti Malaya, Kuala Lumpur, Malaysia.
- Department of Software Engineering, Faculty of Computer Science and Information Technology, Universiti Malaya, Kuala Lumpur, Malaysia.
- Institute of Informatics & Computing in Energy, Universiti Tenaga Nasional, Kajang, Selangor, Malaysia.
ORCID-Profile: Firdaus Afifi, Faiz Zaki, Hazim Hanif, Nor Badrul Anuar
Förderung
- Konsortium Kecemerlangan Penyelidikan
- Fundamental Research Grant Scheme
- Ministry of Higher Education of Malaysia
Zitieren
APA
Afifi, F., Zaki, F., Hanif, H., Aqil, N., & Anuar, N. B. (2025). Transformer-based tokenization for IoT traffic classification across diverse network environments. PeerJ Computer Science, 11, e3126. https://doi.org/10.7717/peerj-cs.3126
Vancouver
Afifi F, Zaki F, Hanif H, Aqil N, Anuar NB. Transformer-based tokenization for IoT traffic classification across diverse network environments. PeerJ Computer Science. 2025;11:e3126. doi:10.7717/peerj-cs.3126
BibTeX
@article{Afifi2025,
author = {Afifi, Firdaus and Zaki, Faiz and Hanif, Hazim and Aqil, Nik and Anuar, Nor Badrul},
title = {Transformer-based tokenization for IoT traffic classification across diverse network environments},
journal = {PeerJ Computer Science},
year = {2025},
volume = {11},
pages = {e3126},
doi = {10.7717/peerj-cs.3126}
}
EUVIMED