Interviewing AI: Using qualitative methods to explore and capture machines’ characteristics and behaviors
Big Data & Society · 2025-09 · 12 (3)
DOI: 10.1177/20539517251381697 ↗Kurz gefasst
Fachartikel in der Zeitschrift Big Data & Society, online erschienen am 19.09.2025. Verfasst von Mohammad Hossein Jarrahi. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 102 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
In this article, we examine the application of qualitative methods for exploring and capturing the emergent behaviors and characteristics of AI systems. In doing so, we formulate key facets of the ‘interviewing AI’ framework: (1) exploratory familiarization to develop an initial understanding of the AI system's functionalities and responses, (2) systematic investigation through structured probing to elicit behaviors such as hallucinations and manifestations of reasoning, using different prompting approaches, and (3) two complementary approaches - temporal and comparative analyses of AI behavior, examining changes over time or comparing multiple systems at a single point in time. We further discuss (4) potential qualitative analysis methods such as critical discourse analysis or content analysis adapted to theorize and interpret AI behaviors, and (5) triangulation, which integrates qualitative insights from interviewing AI with other methods such as user and expert studies, public interaction records analysis, and quantitative analysis to form a multidimensional and comprehensive understanding of AI systems. Finally, we address (6) ethical considerations by emphasizing transparency, reflexivity, and responsible interpretation of findings to ensure rigorous and contextualized research practices.
Zitieren
APA
Jarrahi, M. H. (2025). Interviewing AI: Using qualitative methods to explore and capture machines’ characteristics and behaviors. Big Data & Society, 12(3). https://doi.org/10.1177/20539517251381697
Vancouver
Jarrahi MH. Interviewing AI: Using qualitative methods to explore and capture machines’ characteristics and behaviors. Big Data & Society. 2025;12(3). doi:10.1177/20539517251381697
BibTeX
@article{Jarrahi2025,
author = {Jarrahi, Mohammad Hossein},
title = {Interviewing AI: Using qualitative methods to explore and capture machines’ characteristics and behaviors},
journal = {Big Data & Society},
year = {2025},
volume = {12},
number = {3},
doi = {10.1177/20539517251381697}
}
EUVIMED