EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Experimental Study on Harassment Moderation in Llama and Alpaca

Henrique Tostes de Sousa, Leo Natan Paschoal

Big Data and Cognitive Computing · 24.03.2026 · 10 (4) · 100

DOI: 10.3390/bdcc10040100 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 24.03.2026. Verfasst von Henrique Tostes de Sousa und 1 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundação Araucária de Apoio ao Desenvolvimento Científico e Tecnológico do Estado do Paraná.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The growing integration of chatbots and large language models (LLMs) into society raises important concerns about their potential to reproduce toxic human behaviors. As a result, it is essential to investigate these models to mitigate or eliminate such risks. This paper presents an experimental study evaluating the responses of the Llama and Alpaca models to scenarios involving verbal harassment. The methodology involved using harassment dialogues generated by an LLM as prompts to elicit responses from both models. The responses were then analyzed for levels of toxicity, sexually explicit content, and flirtatiousness. The results indicate that although both models reduce explicit offensive terms, they exhibit limitations in identifying and intercepting abusive behavior from users. Statistical analysis reveals that general-purpose instruction tuning in Alpaca does not provide a robust safety barrier compared to the Llama base model for most variables investigated in the experiment. However, a significant difference was observed concerning flirting, where Llama proved more prone to validation and encouragement than Alpaca. Furthermore, the study identifies critical vulnerabilities, such as a “self-deprecation” bias in Llama and “mirroring” behavior in Alpaca. We also report a complementary triangulation with GPT-family models as a secondary point of reference. This paper discusses and contains content that can be offensive or upsetting.

Förderung

  • Fundação Araucária de Apoio ao Desenvolvimento Científico e Tecnológico do Estado do Paraná

Zitieren

APA

Sousa, H. T. D., & Paschoal, L. N. (2026). An Experimental Study on Harassment Moderation in Llama and Alpaca. Big Data and Cognitive Computing, 10(4), 100. https://doi.org/10.3390/bdcc10040100

Vancouver

Sousa HTD, Paschoal LN. An Experimental Study on Harassment Moderation in Llama and Alpaca. Big Data and Cognitive Computing. 2026;10(4):100. doi:10.3390/bdcc10040100

BibTeX
@article{Sousa2026,
  author = {Sousa, Henrique Tostes de and Paschoal, Leo Natan},
  title = {An Experimental Study on Harassment Moderation in Llama and Alpaca},
  journal = {Big Data and Cognitive Computing},
  year = {2026},
  volume = {10},
  number = {4},
  pages = {100},
  doi = {10.3390/bdcc10040100}
}
Kostenlos starten →