EUVIMEDEUVIMED entdecken
Crossref

Continuous multi-task pre-training for malicious URL detection and webpage classification

Yujie Li, Yiwei Liu, Peiyue Li, Yifan Jia, Yanbin Wang

Computer Networks · 2025-10 · 270 · 111513

DOI: 10.1016/j.comnet.2025.111513 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Networks, 2025-10. Verfasst von Yujie Li und 4 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Malicious URL detection and webpage classification are critical tasks in cybersecurity and information management. In recent years, extensive research has explored using BERT or similar language models to replace traditional machine learning methods for detecting malicious URLs and classifying webpages. While previous studies show promising results, they often apply existing language models to these tasks without accounting for the inherent differences in domain data (e.g., URLs being loosely structured and semantically sparse compared to text), leaving room for performance improvement. Furthermore, current approaches focus on single tasks and have not been tested in multi-task scenarios. To address these challenges, we propose urlBERT, a pre-trained URL encoder leveraging Transformer to encode foundational knowledge from billions of unlabeled URLs. To achieve it, we propose to use 5 unsupervised pretraining tasks to capture multi-level information of URL lexical, syntax, and semantics, and generate contrastive and adversarial representations. Furthermore, to avoid inter-pre-training competition and interference, we proposed a grouped sequential learning method to ensure effective training across multi-tasks. Finally, we leverage a two-stage fine-tuning approach to improve the training stability and efficiency of the task model. To assess the multitasking potential of urlBERT, we fine-tune the task model in both single-task and multi-task modes. The former creates a classification model for a single task, while the latter builds a classification model capable of handling multiple tasks. We evaluate urlBERT on three downstream tasks: phishing URL detection, advertising URL detection, and webpage classification. The results demonstrate that urlBERT outperforms standard pre-trained models, and its multi-task mode is capable of addressing the real-world demands of multitasking.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Li, Y., Liu, Y., Li, P., Jia, Y., & Wang, Y. (2025). Continuous multi-task pre-training for malicious URL detection and webpage classification. Computer Networks, 270, 111513. https://doi.org/10.1016/j.comnet.2025.111513

Vancouver

Li Y, Liu Y, Li P, Jia Y, Wang Y. Continuous multi-task pre-training for malicious URL detection and webpage classification. Computer Networks. 2025;270:111513. doi:10.1016/j.comnet.2025.111513

BibTeX
@article{Li2025,
  author = {Li, Yujie and Liu, Yiwei and Li, Peiyue and Jia, Yifan and Wang, Yanbin},
  title = {Continuous multi-task pre-training for malicious URL detection and webpage classification},
  journal = {Computer Networks},
  year = {2025},
  volume = {270},
  pages = {111513},
  doi = {10.1016/j.comnet.2025.111513}
}
Kostenlos starten →