Developing a Testing Framework for Applications of LLMs within Islamic Finance
World Scientific Annual Review of Islamic Finance · 2025-01 · 03
DOI: 10.1142/s2811023425500029 ↗Kurz gefasst
Fachartikel in der Zeitschrift World Scientific Annual Review of Islamic Finance, online erschienen am 05.03.2026. Verfasst von Qanit Al-Syed und 1 weiteren Autor:innen. Die Arbeit nennt 32 Literaturangaben.
Abstract (Originalsprache)
This study evaluates Large Language Models (LLMs) capabilities in processing Shariah-related queries within Islamic finance. We introduce a three-part benchmark framework. First, a multiple-choice dataset testing factual knowledge. Second, a vulnerability dataset assessing resistance to erroneous fatwas. Third, an applied reasoning dataset evaluating usul al-fiqh methodology. Six models, including ChatGPT, Claude, and a domain-aligned Islamic model, were tested. Results confirm that LLMs are unqualified to issue new Islamic legal rulings, showing susceptibility to theological drift under adversarial prompting. Models also struggled to reliably apply established rulings to familiar scenarios, displaying weaknesses in legal maxims and cross-school reasoning. However, several models demonstrated utility in factual retrieval and the summarization of Islamic finance concepts. This framework provides the first structured benchmark for evaluating Islamic finance AI applications.
Zitieren
APA
Al-Syed, Q., & Mahomed, Z. (2025). Developing a Testing Framework for Applications of LLMs within Islamic Finance. World Scientific Annual Review of Islamic Finance, 03. https://doi.org/10.1142/s2811023425500029
Vancouver
Al-Syed Q, Mahomed Z. Developing a Testing Framework for Applications of LLMs within Islamic Finance. World Scientific Annual Review of Islamic Finance. 2025;03. doi:10.1142/s2811023425500029
BibTeX
@article{AlSyed2025,
author = {Al-Syed, Qanit and Mahomed, Ziyaad},
title = {Developing a Testing Framework for Applications of LLMs within Islamic Finance},
journal = {World Scientific Annual Review of Islamic Finance},
year = {2025},
volume = {03},
doi = {10.1142/s2811023425500029}
}
EUVIMED