What's on My Network? Using Large Language Models to Identify Real-World IoT Devices at Scale
Proceedings of the ACM on Networking · 01.06.2026 · 4 (CoNEXT2) · 1-26
DOI: 10.1145/3808674 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Networking, online erschienen am 01.06.2026. Verfasst von Rameen Mahmood und 3 weiteren Autor:innen. Die Arbeit nennt 97 Literaturangaben. Gefördert von: U.S. National Science Foundation, Consumer Reports Digital Fellowship.
Abstract (Originalsprache)
The growth of IoT devices in shared environments has outpaced our ability to identify them, posing urgent risks to privacy, safety, and accountability. This challenge is especially pronounced in open-world environments, where network traffic metadata is often sparse, noisy, or adversarial. To address this problem, we introduce a semantic inference pipeline that reframes device identification as a language modeling task over real-world network metadata. As this approach depends on reliable supervision, we first construct high-fidelity vendor labels for the IoT Inspector dataset—the largest real-world corpus of its kind—using an ensemble of large language models guided by mutual-information and entropy-based stability scores. We then instruction-tune a quantized LLaMA 3.1 8B model on this dataset using curriculum learning to support generalization under sparsity and long-tail vendor distributions. Our model achieves 98.69% top-1 and 90.73% macro accuracy across 2,015 vendors, while remaining robust to missing fields, protocol drift, and adversarial manipulation. We also evaluate the model on an independent IoT testbed dataset, assess explanation quality, and conduct adversarial tests to probe robustness under spoofed and obfuscated input. These results position instruction-tuned LLMs as a scalable, interpretable foundation for trustworthy device identification at scale.
Förderung
- U.S. National Science Foundation
- Consumer Reports Digital Fellowship
Zitieren
APA
Mahmood, R., Peddinti, S. T., Ahmed, T., & Huang, D. Y. (2026). What's on My Network? Using Large Language Models to Identify Real-World IoT Devices at Scale. Proceedings of the ACM on Networking, 4(CoNEXT2), 1-26. https://doi.org/10.1145/3808674
Vancouver
Mahmood R, Peddinti ST, Ahmed T, Huang DY. What's on My Network? Using Large Language Models to Identify Real-World IoT Devices at Scale. Proceedings of the ACM on Networking. 2026;4(CoNEXT2):1-26. doi:10.1145/3808674
BibTeX
@article{Mahmood2026,
author = {Mahmood, Rameen and Peddinti, Sai Teja and Ahmed, Tousif and Huang, Danny Yuxing},
title = {What's on My Network? Using Large Language Models to Identify Real-World IoT Devices at Scale},
journal = {Proceedings of the ACM on Networking},
year = {2026},
volume = {4},
number = {CoNEXT2},
pages = {1--26},
doi = {10.1145/3808674}
}
EUVIMED