EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

User Needs Analysis in Design Research by Using Large Language Models as Interviewees

Madhurima Das, Xingang Li, Oluwatoba Fabunmi, Katja Hölttö-Otto

Journal of Computing and Information Science in Engineering · 01.08.2026 · 26 (8)

DOI: 10.1115/1.4071386 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computing and Information Science in Engineering, online erschienen am 05.05.2026. Verfasst von Madhurima Das und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The advent of generative artificial intelligence (AI), such as large language models (LLMs), brings a vast range of possibilities and concerns for engineering design. The speed and efficiency of generative AI software can tempt designers to use these tools for the steps of the design process that are most time and resource-intensive, such as conducting thorough user interviews. This study presents results from an experiment comparing four sets of interview data: real-human interviews, designer-filtered interview data, simulated interview data from LLMs without demographic information of the interviewee, and simulated interview data from LLMs with demographic information of the interviewee. All interviews (real and artificial) used the same set of interview questions. The interviews were subsequently assessed for themes using three AI tools: BERTopic, latent Dirichlet allocation, and ChatGPT. These themes were then clustered into user needs by human design experts to generate a comprehensive list of user needs and to compare patterns of user needs between human and AI interviewees. We find that the AI interviews heavily rely on the questions being asked and are unable to convey to the designer if certain topics are irrelevant. On the other hand, we also find that the AI interviews can bring some areas to the designers’ attention not initially present in human interviews that may be relevant to human users and could be verified via follow-up interviews with users.

Zitieren

APA

Das, M., Li, X., Fabunmi, O., & Hölttö-Otto, K. (2026). User Needs Analysis in Design Research by Using Large Language Models as Interviewees. Journal of Computing and Information Science in Engineering, 26(8). https://doi.org/10.1115/1.4071386

Vancouver

Das M, Li X, Fabunmi O, Hölttö-Otto K. User Needs Analysis in Design Research by Using Large Language Models as Interviewees. Journal of Computing and Information Science in Engineering. 2026;26(8). doi:10.1115/1.4071386

BibTeX
@article{Das2026,
  author = {Das, Madhurima and Li, Xingang and Fabunmi, Oluwatoba and Hölttö-Otto, Katja},
  title = {User Needs Analysis in Design Research by Using Large Language Models as Interviewees},
  journal = {Journal of Computing and Information Science in Engineering},
  year = {2026},
  volume = {26},
  number = {8},
  doi = {10.1115/1.4071386}
}
Kostenlos starten →