EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Source-Record Audit of DeepSeek-R1 Responses to Romanized Sindhi Prompts

Irum Naz Sodhar, Dil Nawaz Hakro, Abdul Hafeez Buller, Umair Ramzan Sheikh, Suad Mohammed Al Qassabi, Osama Al Rahbi, Akhtar Hussain, Mohammed Izaan Kari

Computers · 11.08.2026 · 15 (8) · 520

DOI: 10.3390/computers15080520 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers, online erschienen am 11.08.2026. Verfasst von Irum Naz Sodhar und 7 weiteren Autor:innen. Die Arbeit nennt 21 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sindhi language models struggle with Romanized Sindhi as there is variation in the spellings of everyday words, and short prompts do not explicitly state the task or target language. In this study, the remaining source record of a small DeepSeek-R1 probe, which was based on seven canonical prompts and fourteen alleged A/B records, was audited. The screenshot captions were compared with the visible inputs and outputs, and duplication of images was checked. It was only relabeled when there was a single unambiguous canonical prompt that matched the visible input to a record. Task choice and exact target-string occurrence were then coded separately. Six records were auditable, three of which were recovered by relabeling; eight records were not auditable due to being duplicated, contaminated with a supplied answer, associated with a different phrase, or missing the user input or lost after label repair. Four of the six audited records adhered to the experimenter’s task, one provided a reasonably good English translation when the experimenter did not include the target language, and one resulted in an incompatible cross-linguistic reading. Five had the target (English/Sindhi) string and one did not. The screenshots do not demonstrate clear “standard” and “chain of thought” conditions: all audited B-labeled inputs are in the form of a simple prompt and there are no paired wrapper texts remaining. These are descriptive counts, not accuracy estimates and do not provide proof of causal benefit of prompt explicitness. The audit demonstrates the necessity of full prompt–response documentation, independently verified linguistic references, reruns, information-matched prompts, and preregistered evaluation plans in studies with low resources.

Zitieren

APA

Sodhar, I. N., Hakro, D. N., Buller, A. H., Sheikh, U. R., Qassabi, S. M. A., Rahbi, O. A., Hussain, A., & Kari, M. I. (2026). A Source-Record Audit of DeepSeek-R1 Responses to Romanized Sindhi Prompts. Computers, 15(8), 520. https://doi.org/10.3390/computers15080520

Vancouver

Sodhar IN, Hakro DN, Buller AH, Sheikh UR, Qassabi SMA, Rahbi OA, et al. A Source-Record Audit of DeepSeek-R1 Responses to Romanized Sindhi Prompts. Computers. 2026;15(8):520. doi:10.3390/computers15080520

BibTeX
@article{Sodhar2026,
  author = {Sodhar, Irum Naz and Hakro, Dil Nawaz and Buller, Abdul Hafeez and Sheikh, Umair Ramzan and Qassabi, Suad Mohammed Al and Rahbi, Osama Al and Hussain, Akhtar and Kari, Mohammed Izaan},
  title = {A Source-Record Audit of DeepSeek-R1 Responses to Romanized Sindhi Prompts},
  journal = {Computers},
  year = {2026},
  volume = {15},
  number = {8},
  pages = {520},
  doi = {10.3390/computers15080520}
}
Kostenlos starten →