Continuous multi-task pre-training for malicious URL detection and webpage classification
Computer Networks · 2025-10 · 270 · 111513
DOI: 10.1016/j.comnet.2025.111513 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Networks, 2025-10. Verfasst von Yujie Li und 4 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Malicious URL detection and webpage classification are critical tasks in cybersecurity and information management. In recent years, extensive research has explored using BERT or similar language models to replace traditional machine learning methods for detecting malicious URLs and classifying webpages. While previous studies show promising results, they often apply existing language models to these tasks without accounting for the inherent differences in domain data (e.g., URLs being loosely structured and semantically sparse compared to text), leaving room for performance improvement. Furthermore, current approaches focus on single tasks and have not been tested in multi-task scenarios. To address these challenges, we propose urlBERT, a pre-trained URL encoder leveraging Transformer to encode foundational knowledge from billions of unlabeled URLs. To achieve it, we propose to use 5 unsupervised pretraining tasks to capture multi-level information of URL lexical, syntax, and semantics, and generate contrastive and adversarial representations. Furthermore, to avoid inter-pre-training competition and interference, we proposed a grouped sequential learning method to ensure effective training across multi-tasks. Finally, we leverage a two-stage fine-tuning approach to improve the training stability and efficiency of the task model. To assess the multitasking potential of urlBERT, we fine-tune the task model in both single-task and multi-task modes. The former creates a classification model for a single task, while the latter builds a classification model capable of handling multiple tasks. We evaluate urlBERT on three downstream tasks: phishing URL detection, advertising URL detection, and webpage classification. The results demonstrate that urlBERT outperforms standard pre-trained models, and its multi-task mode is capable of addressing the real-world demands of multitasking.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Li, Y., Liu, Y., Li, P., Jia, Y., & Wang, Y. (2025). Continuous multi-task pre-training for malicious URL detection and webpage classification. Computer Networks, 270, 111513. https://doi.org/10.1016/j.comnet.2025.111513
Vancouver
Li Y, Liu Y, Li P, Jia Y, Wang Y. Continuous multi-task pre-training for malicious URL detection and webpage classification. Computer Networks. 2025;270:111513. doi:10.1016/j.comnet.2025.111513
BibTeX
@article{Li2025,
author = {Li, Yujie and Liu, Yiwei and Li, Peiyue and Jia, Yifan and Wang, Yanbin},
title = {Continuous multi-task pre-training for malicious URL detection and webpage classification},
journal = {Computer Networks},
year = {2025},
volume = {270},
pages = {111513},
doi = {10.1016/j.comnet.2025.111513}
}
EUVIMED