EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Human Oversight During AI-Assisted Documentary Coding: An Empirical Study of Decisions, Interventions, and Traceability

Catherine Tan Lee Huan, Aaron Aw Teik Hong, Tekenate Ebibio Amah, Anusuyah Subbarao

Information · 19.11.2026 · 17 (11) · 1177

DOI: 10.3390/info17111177 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 19.11.2026. Verfasst von Catherine Tan Lee Huan und 3 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Multimedia University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A researcher agrees with an AI auditor that a coded category is unsupported and should be removed. The category is still present in the analysed dataset, and no record explains why. When decisions and data are recorded separately, such cases remain hidden, because neither record shows whether one reached the other. This retrospective study linked the two kinds of records in a completed project in which supervised AI systems coded 11,458 online reviews and 187 complaints about the Singapore–Malaysia confinement nanny market. Selected decisions were traced into the analysed data, and all 276 saved batch files were compared to identify changes that no decision explained. Whether a change could be traced depended on how it was made. Corrections logged by record and field were fully traceable. Recoding was not. Three recoded batches produced 109 changes, and only six of these could be linked to a decision about that record. Thirty-one saved files were also modified later, without their earlier contents being kept. Despite these gaps, none of the counts used in the project’s analysis changed, although only rebuilding them afterwards revealed this. A recorded decision is not evidence that it was carried out. The study proposes records that would provide that evidence, for future projects to test.

Förderung

  • Multimedia University

Zitieren

APA

Huan, C. T. L., Hong, A. A. T., Amah, T. E., & Subbarao, A. (2026). Human Oversight During AI-Assisted Documentary Coding: An Empirical Study of Decisions, Interventions, and Traceability. Information, 17(11), 1177. https://doi.org/10.3390/info17111177

Vancouver

Huan CTL, Hong AAT, Amah TE, Subbarao A. Human Oversight During AI-Assisted Documentary Coding: An Empirical Study of Decisions, Interventions, and Traceability. Information. 2026;17(11):1177. doi:10.3390/info17111177

BibTeX
@article{Huan2026,
  author = {Huan, Catherine Tan Lee and Hong, Aaron Aw Teik and Amah, Tekenate Ebibio and Subbarao, Anusuyah},
  title = {Human Oversight During AI-Assisted Documentary Coding: An Empirical Study of Decisions, Interventions, and Traceability},
  journal = {Information},
  year = {2026},
  volume = {17},
  number = {11},
  pages = {1177},
  doi = {10.3390/info17111177}
}
Kostenlos starten →