EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluation of Federated Learning in Phishing Email Detection

Chandra Thapa iD, Jun Wen Tang iD, Alsharif Abuadbba iD, Yansong Gao, Seyit Camtepe iD, Surya Nepal, Mahathir Almashor iD, Yifeng Zheng

Sensors · 27.04.2023 · 23 (9) · 4346

DOI: 10.3390/s23094346 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 27.04.2023. Verfasst von Chandra Thapa und 7 weiteren Autor:innen. Beteiligte Einrichtung: Commonwealth Scientific and Industrial Research Organisation, Data61, Sydney 2122, Australia. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Partially supported by the Cyber Security Cooperative Research Centre, 639 Australia., Cyber Security Cooperative Research Centre.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The use of artificial intelligence (AI) to detect phishing emails is primarily dependent on large-scale centralized datasets, which has opened it up to a myriad of privacy, trust, and legal issues. Moreover, organizations have been loath to share emails, given the risk of leaking commercially sensitive information. Consequently, it has been difficult to obtain sufficient emails to train a global AI model efficiently. Accordingly, privacy-preserving distributed and collaborative machine learning, particularly federated learning (FL), is a desideratum. As it is already prevalent in the healthcare sector, questions remain regarding the effectiveness and efficacy of FL-based phishing detection within the context of multi-organization collaborations. To the best of our knowledge, the work herein was the first to investigate the use of FL in phishing email detection. This study focused on building upon a deep neural network model, particularly recurrent convolutional neural network (RNN) and bidirectional encoder representations from transformers (BERT), for phishing email detection. We analyzed the FL-entangled learning performance in various settings, including (i) a balanced and asymmetrical data distribution among organizations and (ii) scalability. Our results corroborated the comparable performance statistics of FL in phishing email detection to centralized learning for balanced datasets and low organizational counts. Moreover, we observed a variation in performance when increasing the organizational counts. For a fixed total email dataset, the global RNN-based model had a 1.8% accuracy decrease when the organizational counts were increased from 2 to 10. In contrast, BERT accuracy increased by 0.6% when increasing organizational counts from 2 to 5. However, if we increased the overall email dataset by introducing new organizations in the FL framework, the organizational level performance improved by achieving a faster convergence speed. In addition, FL suffered in its overall global model performance due to highly unstable outputs if the email dataset distribution was highly asymmetric.

Schlagwörter

Stichwörter der Autor:innen

bidirectional encoder representations from transformers (BERT)federated learningphishing email detectionrecurrent neural network

Autor:innen und Institutionen

  • Commonwealth Scientific and Industrial Research Organisation, Data61, Sydney 2122, Australia.
  • School of Chemical Engineering, The University of New South Wales, Sydney 2052, Australia.
  • Cyber Security Cooperative Research Centre, Australian Capital Territory 2604, Australia.
  • Harbin Institute of Technology, Harbin 150001, China.

ORCID-Profile: Chandra Thapa, Jun Wen Tang, Alsharif Abuadbba, Seyit Camtepe, Mahathir Almashor

Förderung

  • Partially supported by the Cyber Security Cooperative Research Centre, 639 Australia.
  • Cyber Security Cooperative Research Centre

Zitieren

APA

Thapa, C., Tang, J. W., Abuadbba, A., Gao, Y., Camtepe, S., Nepal, S., Almashor, M., & Zheng, Y. (2023). Evaluation of Federated Learning in Phishing Email Detection. Sensors, 23(9), 4346. https://doi.org/10.3390/s23094346

Vancouver

Thapa C, Tang JW, Abuadbba A, Gao Y, Camtepe S, Nepal S, et al. Evaluation of Federated Learning in Phishing Email Detection. Sensors. 2023;23(9):4346. doi:10.3390/s23094346

BibTeX
@article{Thapa2023,
  author = {Thapa, Chandra and Tang, Jun Wen and Abuadbba, Alsharif and Gao, Yansong and Camtepe, Seyit and Nepal, Surya and Almashor, Mahathir and Zheng, Yifeng},
  title = {Evaluation of Federated Learning in Phishing Email Detection},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {9},
  pages = {4346},
  doi = {10.3390/s23094346}
}
Kostenlos starten →