EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Comparative Analysis of Prompt Strategies for Large Language Models: Single-Task vs. Multitask Prompts

Manuel Gozzi, Federico Di Maio

Electronics · 28.11.2024 · 13 (23) · 4712

DOI: 10.3390/electronics13234712 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 28.11.2024. Verfasst von Manuel Gozzi und 1 weiteren Autor:innen. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study investigates the effectiveness of prompt engineering strategies for Large Language Models (LLMs), comparing single-task and multitasking prompts. Specifically, we analyze whether a single prompt handling multiple tasks—such as named entity recognition (NER), sentiment analysis, and JSON output formatting—can achieve performance comparable to dedicated single-task prompts. To substantiate our findings, we employ statistical analyses, including paired Wilcoxon tests, McNemar tests, and Friedman tests, to validate claims of performance similarity or superiority. Experiments were conducted using five open-weight LLMs: LLama3.1 8B, Qwen2 7B, Mistral 7B, Phi3 Medium, and Gemma2 9B. The results indicate that there is no definitive rule favoring single-task prompts over multitask prompts; rather, their relative performance is highly contingent on the specific model’s data and architecture. This study highlights the nuanced interplay between prompt strategies and LLM characteristics, offering insights into optimizing their use for specific NLP tasks. Limitations and future directions, such as expanding task types, are also discussed.

Zitieren

APA

Gozzi, M., & Maio, F. D. (2024). Comparative Analysis of Prompt Strategies for Large Language Models: Single-Task vs. Multitask Prompts. Electronics, 13(23), 4712. https://doi.org/10.3390/electronics13234712

Vancouver

Gozzi M, Maio FD. Comparative Analysis of Prompt Strategies for Large Language Models: Single-Task vs. Multitask Prompts. Electronics. 2024;13(23):4712. doi:10.3390/electronics13234712

BibTeX
@article{Gozzi2024,
  author = {Gozzi, Manuel and Maio, Federico Di},
  title = {Comparative Analysis of Prompt Strategies for Large Language Models: Single-Task vs. Multitask Prompts},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {23},
  pages = {4712},
  doi = {10.3390/electronics13234712}
}
Kostenlos starten →