EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Analyzing Higher Education Students’ Prompting Techniques and Their Impact on ChatGPT’s Performance: An Exploratory Study in Spanish

José Luis Carrasco-Sáez, Carolina Contreras-Saavedra, Sheny San-Martín-Quiroga, Carla E. Contreras-Saavedra, Rhoddy Viveros-Muñoz

Applied Sciences · 08.07.2025 · 15 (14) · 7651

DOI: 10.3390/app15147651 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 08.07.2025. Verfasst von José Luis Carrasco-Sáez und 4 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: ANID FONDECYT Postdoc, ANID Capital humano Beca Doctorado Nacional Foil 21231752.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Generative artificial intelligence is reshaping how people interact with digital technologies, emphasizing the need to develop effective skills for engaging with it. In this context, prompt engineering has emerged as a critical skill for optimizing AI-generated outputs. However, research on how higher education students interact with these technologies remains limited, particularly in non-English-speaking contexts. This exploratory study examines how 102 higher education students in Chile formulated prompts in Spanish and how their techniques influenced the responses generated by ChatGPT (free version 3.5). A quantitative analysis was conducted to assess the relationship between prompt techniques and response quality. Two emergent prompt engineering strategies were identified: the Guide Contextualization Strategy and the Specific Purpose Strategy. The Guide Contextualization Strategy focused on providing explicit contextual information to guide ChatGPT’s responses, aligning with few-shot prompting, while the Specific Purpose Strategy emphasized defining the request’s purpose, aligning with structured objective formulation strategies. The regression analysis indicated that the Guide Contextualization Strategy had a greater impact on response quality, reinforcing the importance of contextual information in effective interactions with large language models. As an exploratory study, these findings provide preliminary evidence on prompt engineering strategies in Spanish, a relatively unexplored area in artificial intelligence education research. Based on these results, a methodological framework is proposed, encompassing four key dimensions: grammatical skills; prompt strategies; response from the large language model; and evaluation of response quality. This framework lays the groundwork for future artificial intelligence digital literacy interventions, fostering critical and effective engagement with generative artificial intelligence while also highlighting the need for further research to validate and expand these initial insights.

Förderung

  • ANID FONDECYT Postdoc
  • ANID Capital humano Beca Doctorado Nacional Foil 21231752

Zitieren

APA

Carrasco-Sáez, J. L., Contreras-Saavedra, C., San-Martín-Quiroga, S., Contreras-Saavedra, C. E., & Viveros-Muñoz, R. (2025). Analyzing Higher Education Students’ Prompting Techniques and Their Impact on ChatGPT’s Performance: An Exploratory Study in Spanish. Applied Sciences, 15(14), 7651. https://doi.org/10.3390/app15147651

Vancouver

Carrasco-Sáez JL, Contreras-Saavedra C, San-Martín-Quiroga S, Contreras-Saavedra CE, Viveros-Muñoz R. Analyzing Higher Education Students’ Prompting Techniques and Their Impact on ChatGPT’s Performance: An Exploratory Study in Spanish. Applied Sciences. 2025;15(14):7651. doi:10.3390/app15147651

BibTeX
@article{CarrascoSez2025,
  author = {Carrasco-Sáez, José Luis and Contreras-Saavedra, Carolina and San-Martín-Quiroga, Sheny and Contreras-Saavedra, Carla E. and Viveros-Muñoz, Rhoddy},
  title = {Analyzing Higher Education Students’ Prompting Techniques and Their Impact on ChatGPT’s Performance: An Exploratory Study in Spanish},
  journal = {Applied Sciences},
  year = {2025},
  volume = {15},
  number = {14},
  pages = {7651},
  doi = {10.3390/app15147651}
}
Kostenlos starten →