EUVIMEDEUVIMED entdecken
Crossref

Evaluation of Prompting Strategies for Cyberbullying Detection Using Various Large Language Models

Anamika Gupta, Sakshi Garg, Harsh Bamotra

Advances in Knowledge-Based Systems, Data Science, and Cybersecurity · 2025

DOI: 10.54364/cybersecurityjournal.2025.1109 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Advances in Knowledge-Based Systems, Data Science, and Cybersecurity, 2025. Verfasst von Anamika Gupta und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sentiment analysis detects toxic language for safer online spaces and helps businesses refine strategies through customer feedback analysis [1, 2]. Advancements in Large Language Models (LLMs) and prompt engineering have introduced novel approaches to sentiment analysis, cyberbullying detection, and toxicity classification. However, several challenges persist, particularly in handling text ambiguity, sarcasm, multilingual contexts, and nuanced emotional comprehension, which limit the ability to achieve accurate and human-aligned results. This study uses the CYBY23 dataset, which contains 112 human-annotated threads. To balance the dataset, synthetic threads were generated using ChatGPT, resulting in a final dataset of 148 threads evenly distributed across two labels: 0 (bullying with no aggression) and 1 (bullying with aggression). Three publicly available LLMs—Deepseek-r1-distillllama-70b (Deepseek), Qwen-2.5-32b (Qwen) and llama3-70b-8192 (Llama)—were systematically evaluated using zero-shot, one-shot, and few-shot prompting strategies, with all models accessed via Groq Cloud APIs. The model outputs were assessed using recall, precision, F1 scores, and accuracy to measure performance in different prompting techniques (PT). In this report, Qwen achieved the highest overall accuracy at 82.43% in few-shot 2, while Llama matched that accuracy in one-shot 2, demonstrating solid performance in few-shot tasks as well. Deepseek showed high variability, thriving with contextual enhancements in zero-shot 2 but struggling in one-shot and fluctuating in few-shot settings. one-shot prompting proved most effective for Llama, while few-shot methods worked best for both Qwen and Llama.

Zitieren

APA

Gupta, A., Garg, S., & Bamotra, H. (2025). Evaluation of Prompting Strategies for Cyberbullying Detection Using Various Large Language Models. Advances in Knowledge-Based Systems, Data Science, and Cybersecurity. https://doi.org/10.54364/cybersecurityjournal.2025.1109

Vancouver

Gupta A, Garg S, Bamotra H. Evaluation of Prompting Strategies for Cyberbullying Detection Using Various Large Language Models. Advances in Knowledge-Based Systems, Data Science, and Cybersecurity. 2025. doi:10.54364/cybersecurityjournal.2025.1109

BibTeX
@article{Gupta2025,
  author = {Gupta, Anamika and Garg, Sakshi and Bamotra, Harsh},
  title = {Evaluation of Prompting Strategies for Cyberbullying Detection Using Various Large Language Models},
  journal = {Advances in Knowledge-Based Systems, Data Science, and Cybersecurity},
  year = {2025},
  doi = {10.54364/cybersecurityjournal.2025.1109}
}
Kostenlos starten →