Evaluating AI Language Models in News Retrieval: A Comparative Study Of ChatGPT-Plus and DeepSeek (R1)
InfoTech Spectrum: Iraqi Journal of Data Science · 2024
DOI: 10.51173/ijds.v2i2.33 ↗Kurz gefasst
Fachartikel in der Zeitschrift InfoTech Spectrum: Iraqi Journal of Data Science, 2024. Verfasst von Omar Al-Janabi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 32 Literaturangaben.
Abstract (Originalsprache)
The increasing complexity of how humans interact with and process information has demonstrated significant advancements in Natural Language Processing (NLP), transitioning from task-specific architectures to generalized frameworks applicable across multiple tasks. Despite their success, challenges persist in specialized domains such as translation, where instruction tuning may prioritize fluency over accuracy. Against this backdrop, the present study conducts a comparative evaluation of ChatGPT-Plus and DeepSeek (R1) on a high-fidelity bilingual retrieval-and-translation task. A single standardize prompt directs each model to access the Arabic-language news section of the College of Medicine, University of Baghdad, retrieve the three most recent articles, and translate them into English. ChatGPT-Plus fulfilled the prompt successfully, extracting authentic Arabic content and delivering fluent, semantically accurate English translations. DeepSeek (R1), by contrast, failed to retrieve the requested articles and instead produced only generic procedural advice – evidence of its lack of real-time web access and a retrieval-augmented generation (RAG) mechanism.
Zitieren
APA
Al-Janabi, O., Alyasiri, O. M., Jebur, E. A., & Nafl, S. M. (2024). Evaluating AI Language Models in News Retrieval: A Comparative Study Of ChatGPT-Plus and DeepSeek (R1). InfoTech Spectrum: Iraqi Journal of Data Science. https://doi.org/10.51173/ijds.v2i2.33
Vancouver
Al-Janabi O, Alyasiri OM, Jebur EA, Nafl SM. Evaluating AI Language Models in News Retrieval: A Comparative Study Of ChatGPT-Plus and DeepSeek (R1). InfoTech Spectrum: Iraqi Journal of Data Science. 2024. doi:10.51173/ijds.v2i2.33
BibTeX
@article{AlJanabi2024,
author = {Al-Janabi, Omar and Alyasiri, Osamah Mohammed and Jebur, Elaf Ayyed and Nafl, Shahad Mohgoob},
title = {Evaluating AI Language Models in News Retrieval: A Comparative Study Of ChatGPT-Plus and DeepSeek (R1)},
journal = {InfoTech Spectrum: Iraqi Journal of Data Science},
year = {2024},
doi = {10.51173/ijds.v2i2.33}
}
EUVIMED