EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Large Language Models meet moral values: A comprehensive assessment of moral abilities

Luana Bulla, Stefano De Giorgis, Misael Mongiovì, Aldo Gangemi

Computers in Human Behavior Reports · 2025-03 · 17 · 100609

DOI: 10.1016/j.chbr.2025.100609 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers in Human Behavior Reports, 2025-03. Verfasst von Luana Bulla und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministero dell'Istruzione dell'Università e della Ricerca, European Commission.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automatic moral classification in textual data is crucial for various fields including Natural Language Processing (NLP), social sciences, and ethical AI development. Despite advancements in supervised models, their performance often suffers when faced with real-world scenarios due to overfitting to specific data distributions. To address these limitations, we propose leveraging state-of-the-art Large Language Models (LLMs) trained on extensive common-sense data for unsupervised moral classification. We introduce an innovative evaluation framework that directly compares model outputs with human annotations, ensuring an assessment of model performance. Our methodology explores the effectiveness of different LLM sizes and prompt designs in moral value detection tasks, considering both multi-label and binary classification scenarios. We present experimental results using the Moral Foundation Reddit Corpus (MFRC) and discuss implications for future research in ethical AI development and human–computer interaction. Experimental results demonstrate that GPT-4 achieves superior performance, followed by GPT-3.5, Llama-70B, Mixtral-8x7B, Mistral-7B and Llama-7B. Additionally, the study reveals significant variations in model performance across different moral domains, particularly between everyday morality and political contexts. Our work provides meaningful insights into the use of zero-shot and few-shot models for moral value detection and discusses the potential and limitations of current technology in this task.

Förderung

  • Ministero dell'Istruzione dell'Università e della Ricerca
  • European Commission

Zitieren

APA

Bulla, L., Giorgis, S. D., Mongiovì, M., & Gangemi, A. (2025). Large Language Models meet moral values: A comprehensive assessment of moral abilities. Computers in Human Behavior Reports, 17, 100609. https://doi.org/10.1016/j.chbr.2025.100609

Vancouver

Bulla L, Giorgis SD, Mongiovì M, Gangemi A. Large Language Models meet moral values: A comprehensive assessment of moral abilities. Computers in Human Behavior Reports. 2025;17:100609. doi:10.1016/j.chbr.2025.100609

BibTeX
@article{Bulla2025,
  author = {Bulla, Luana and Giorgis, Stefano De and Mongiovì, Misael and Gangemi, Aldo},
  title = {Large Language Models meet moral values: A comprehensive assessment of moral abilities},
  journal = {Computers in Human Behavior Reports},
  year = {2025},
  volume = {17},
  pages = {100609},
  doi = {10.1016/j.chbr.2025.100609}
}
Kostenlos starten →