EUVIMEDDescoperă EUVIMED
Crossref

Recommendations for the integration of generative artificial intelligence in support of engineering education research workflows

Alejandra J. Magana, Ryan Watkins, Camilo Vieira

Journal of Engineering Education · 2026-01 · 115 (1)

DOI: 10.1002/jee.70043 ↗

At a glance

Journal article in Journal of Engineering Education, published online on 2025-12-04. Written by Alejandra J. Magana and 2 co-authors. Cited 6 times so far (Crossref); 16 references. Funded by: National Science Foundation.

RezumatDate bibliograficeCiteRelated studies

Abstract (original language)

) use generative AI to investigate the persistent issue of attrition in computer science (CS) and the factors influencing career changes across various stages and contexts, guided by two key questions: (1) What are the reasons for leaving? and (2) What external factors influence these decisions? The authors conducted a large-scale qualitative study by collecting over 10,000 Reddit posts through keyword-based scraping and refining them to 263 relevant posts using generative AI for efficient data filtering. They then applied the generative AI – enabled theme organization and structuring (GATOS) workflow for AI-assisted thematic analysis, which mimics human qualitative analysis steps: reading raw data, summarizing it into distinct ideas with the Qwen2.5-32b model, identifying semantically similar ideas, creating the codebook iteratively (including k-nearest neighbors and cosine similarity matching), and simplifying the codebook into broader themes. This process was extended with a rigorous “ human-in-the-loop ” approach to ensure accuracy, depth, and contextualization of the AI-generated themes. Social cognitive career theory (SCCT) provided the theoretical lens for interpreting and mapping the AI-generated factors to SCCT constructs (interest, choice, performance, and satisfaction). The analysis revealed six core reasons for departure, namely job dissatisfaction, academic struggles, psychological and emotional factors, interests in other fields, health concerns, and broader industry issues. The analysis also identified influential external factors, including background and preparation, transition requirements, the nature of alternative fields, and personal circumstances. Notably, these reasons and factors appeared across all stages of departure, although their impact varied. The authors emphasize both the advantages of generative AI — such as unprecedented scalability and the ability to generate more generalizable insights — and the ethical considerations of privacy, bias, and AI accuracy. They addressed these concerns by using only publicly available Reddit data and maintaining human oversight for continuous validation. A significant contribution of this study is the demonstration of a replicable, scalable methodology for large-scale qualitative research using generative AI and NLP-assisted methods, offering a model for future studies that face the challenge of limited datasets for NLP

Funding

  • National Science Foundation

Cite

APA

Magana, A. J., Watkins, R., & Vieira, C. (2026). Recommendations for the integration of generative artificial intelligence in support of engineering education research workflows. Journal of Engineering Education, 115(1). https://doi.org/10.1002/jee.70043

Vancouver

Magana AJ, Watkins R, Vieira C. Recommendations for the integration of generative artificial intelligence in support of engineering education research workflows. Journal of Engineering Education. 2026;115(1). doi:10.1002/jee.70043

BibTeX
@article{Magana2026,
  author = {Magana, Alejandra J. and Watkins, Ryan and Vieira, Camilo},
  title = {Recommendations for the integration of generative artificial intelligence in support of engineering education research workflows},
  journal = {Journal of Engineering Education},
  year = {2026},
  volume = {115},
  number = {1},
  doi = {10.1002/jee.70043}
}
Start for free →