ORBIT-CL: A Semantically-Aware and Lightweight Multimodal Transformer for Cyberbullying Detection
Engineering, Technology & Applied Science Research · 06.06.2026 · 16 (3) · 35470-35476
DOI: 10.48084/etasr.18187 ↗Kurz gefasst
Fachartikel in der Zeitschrift Engineering, Technology & Applied Science Research, online erschienen am 06.06.2026. Verfasst von Saed Alqaraleh. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Cyberbullying appears in complex forms, namely (1) syntactic obfuscations, (2) context-dependent multimodal memes, and (3) semantically ambiguous text (e.g., sarcasm or reclaimed slurs). The present study proposes a Contrastive and Lightweight Multimodal Transformer, ORBIT-CL, an end-to-end system addressing all three challenges. It combines lightweight multimodal feature extraction (Transformer-based OCR (TrOCR) and visual object tags) with a RoBERTa-based classifier. This classifier employs a dual-robustness objective: adversarial noise training alongside semantic contrastive learning to handle both syntactic attacks and intent ambiguity. The system uses multi-task heads for binary bullying detection and ordinal hostility and calibration modules to maintain stable moderation thresholds. The experimental protocol, which includes challenge sets, was designed to address semantic ambiguity. Using publicly available datasets (HateXplain and Hateful Memes), ORBIT-CL achieved highly competitive performance (0.88 Macro-F1) on the full HateXplain benchmark. To specifically validate its semantic robustness, it also achieved a 30-point F1 gain on a targeted challenge set of ambiguous content (e.g., sarcasm, reclaimed slurs), thereby addressing a key failure mode of prior models. Furthermore, by fusing lightweight visual tags as text, the introduced model achieved 0.895 Area Under the Receiver Operating Characteristic (AUROC) curve on Hateful Memes, demonstrating a highly efficient alternative to heavy multimodal baselines while retaining the efficiency of a text-only encoder. By unifying lightweight multimodal fusion with a dual (syntactic and semantic) robustness framework, ORBIT-CL contributes to deployable, context-aware, and efficient cyberbullying detection.
Zitieren
APA
Alqaraleh, S. (2026). ORBIT-CL: A Semantically-Aware and Lightweight Multimodal Transformer for Cyberbullying Detection. Engineering, Technology & Applied Science Research, 16(3), 35470-35476. https://doi.org/10.48084/etasr.18187
Vancouver
Alqaraleh S. ORBIT-CL: A Semantically-Aware and Lightweight Multimodal Transformer for Cyberbullying Detection. Engineering, Technology & Applied Science Research. 2026;16(3):35470-35476. doi:10.48084/etasr.18187
BibTeX
@article{Alqaraleh2026,
author = {Alqaraleh, Saed},
title = {ORBIT-CL: A Semantically-Aware and Lightweight Multimodal Transformer for Cyberbullying Detection},
journal = {Engineering, Technology & Applied Science Research},
year = {2026},
volume = {16},
number = {3},
pages = {35470--35476},
doi = {10.48084/etasr.18187}
}
EUVIMED