Objective metrics for ethical AI: a systematic literature review
International Journal of Data Science and Analytics · 2025-08 · 20 (2) · 247-267
DOI: 10.1007/s41060-024-00541-w ↗Kurz gefasst
Systematische Übersicht in der Zeitschrift International Journal of Data Science and Analytics, online erschienen am 13.04.2024. Verfasst von Guilherme Palumbo und 2 weiteren Autor:innen. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundae a Tecnologia, NextGeneration EU.
Abstract (Originalsprache)
The field of AI Ethics has recently gained considerable attention, yet much of the existing academic research lacks practical and objective contributions for the development of ethical AI systems. This systematic literature review aims to identify and map objective metrics documented in literature between January 2018 and June 2023, specifically focusing on the ethical principles outlined in the Ethics Guidelines for Trustworthy AI. The review was based on 66 articles retrieved from the Scopus and World of Science databases. The articles were categorized based on their alignment with seven ethical principles: Human Agency and Oversight, Technical Robustness and Safety, Privacy and Data Governance, Transparency, Diversity, Non-Discrimination and Fairness, Societal and Environmental Well-being, and Accountability. Of the identified articles, only a minority presented objective metrics to assess AI ethics, with the majority being purely theoretical works. Moreover, existing metrics are primarily concentrating on Diversity, Non-Discrimination and Fairness, with a clear under-representation of the remaining principles. This lack of practical contributions makes it difficult for Data Scientists to devise systems that can be deemed Ethical, or to monitor the alignment of existing systems with current guidelines and legislation. With this work, we lay out the current panorama concerning objective metrics to quantify AI Ethics in Data Science and highlight the areas in which future developments are needed to align Data Science projects with the human values widely posited in the literature.
Förderung
- Fundae a Tecnologia
- NextGeneration EU
Zitieren
APA
Palumbo, G., Carneiro, D., & Alves, V. (2025). Objective metrics for ethical AI: a systematic literature review. International Journal of Data Science and Analytics, 20(2), 247-267. https://doi.org/10.1007/s41060-024-00541-w
Vancouver
Palumbo G, Carneiro D, Alves V. Objective metrics for ethical AI: a systematic literature review. International Journal of Data Science and Analytics. 2025;20(2):247-267. doi:10.1007/s41060-024-00541-w
BibTeX
@article{Palumbo2025,
author = {Palumbo, Guilherme and Carneiro, Davide and Alves, Victor},
title = {Objective metrics for ethical AI: a systematic literature review},
journal = {International Journal of Data Science and Analytics},
year = {2025},
volume = {20},
number = {2},
pages = {247--267},
doi = {10.1007/s41060-024-00541-w}
}
EUVIMED