Auditing Artificial Intelligence: Context Engineering with Retrieval-Augmented Generation
Journal of Information Systems · 01.10.2026 · 40 (3) · 107-133
DOI: 10.2308/isys-2025-045 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Information Systems, online erschienen am 08.10.2026. Verfasst von Mark D. Sheldon. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 78 Literaturangaben.
Abstract (Originalsprache)
Retrieval-augmented generation (RAG) systems enhance large language models (LLMs) by integrating dynamic external data, enabling more contextually relevant and accurate outputs. As these systems gain traction in accounting applications (e.g., financial reporting, auditing, and tax), concerns emerge regarding data reliability, control oversight, and auditability. This study applies Design Science Research Methodology to develop a practical control framework tailored to the four core stages of a typical RAG system: External Data Management, User Interaction and Query Flow, Retrieval and Prompt Construction, and LLM Inference and Response. The proposed framework includes control objectives linked to stage-specific risks relevant to financial reporting. Iterative validation was conducted using an innovative multi-LLM consensus process to ensure coverage and reduce hallucination risk. This study contributes a framework for evaluating artificial intelligence (AI)-integrated systems, guidance for auditors and regulators to assess probabilistic AI outputs, extension of existing audit control frameworks, and instructional materials for accounting educators.
Zitieren
APA
Sheldon, M. D. (2026). Auditing Artificial Intelligence: Context Engineering with Retrieval-Augmented Generation. Journal of Information Systems, 40(3), 107-133. https://doi.org/10.2308/isys-2025-045
Vancouver
Sheldon MD. Auditing Artificial Intelligence: Context Engineering with Retrieval-Augmented Generation. Journal of Information Systems. 2026;40(3):107-133. doi:10.2308/isys-2025-045
BibTeX
@article{Sheldon2026,
author = {Sheldon, Mark D.},
title = {Auditing Artificial Intelligence: Context Engineering with Retrieval-Augmented Generation},
journal = {Journal of Information Systems},
year = {2026},
volume = {40},
number = {3},
pages = {107--133},
doi = {10.2308/isys-2025-045}
}
EUVIMED