EUVIMEDEUVIMED entdecken
Crossref

Developing a Testing Framework for Applications of LLMs within Islamic Finance

Qanit Al-Syed, Ziyaad Mahomed

World Scientific Annual Review of Islamic Finance · 2025-01 · 03

DOI: 10.1142/s2811023425500029 ↗

Kurz gefasst

Fachartikel in der Zeitschrift World Scientific Annual Review of Islamic Finance, online erschienen am 05.03.2026. Verfasst von Qanit Al-Syed und 1 weiteren Autor:innen. Die Arbeit nennt 32 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study evaluates Large Language Models (LLMs) capabilities in processing Shariah-related queries within Islamic finance. We introduce a three-part benchmark framework. First, a multiple-choice dataset testing factual knowledge. Second, a vulnerability dataset assessing resistance to erroneous fatwas. Third, an applied reasoning dataset evaluating usul al-fiqh methodology. Six models, including ChatGPT, Claude, and a domain-aligned Islamic model, were tested. Results confirm that LLMs are unqualified to issue new Islamic legal rulings, showing susceptibility to theological drift under adversarial prompting. Models also struggled to reliably apply established rulings to familiar scenarios, displaying weaknesses in legal maxims and cross-school reasoning. However, several models demonstrated utility in factual retrieval and the summarization of Islamic finance concepts. This framework provides the first structured benchmark for evaluating Islamic finance AI applications.

Zitieren

APA

Al-Syed, Q., & Mahomed, Z. (2025). Developing a Testing Framework for Applications of LLMs within Islamic Finance. World Scientific Annual Review of Islamic Finance, 03. https://doi.org/10.1142/s2811023425500029

Vancouver

Al-Syed Q, Mahomed Z. Developing a Testing Framework for Applications of LLMs within Islamic Finance. World Scientific Annual Review of Islamic Finance. 2025;03. doi:10.1142/s2811023425500029

BibTeX
@article{AlSyed2025,
  author = {Al-Syed, Qanit and Mahomed, Ziyaad},
  title = {Developing a Testing Framework for Applications of LLMs within Islamic Finance},
  journal = {World Scientific Annual Review of Islamic Finance},
  year = {2025},
  volume = {03},
  doi = {10.1142/s2811023425500029}
}
Kostenlos starten →