A Comparative Analysis of Sentence Transformer Models for Automated Journal Recommendation Using PubMed Metadata
Big Data and Cognitive Computing · 13.03.2025 · 9 (3) · 67
DOI: 10.3390/bdcc9030067 ↗Kurz gefasst
Fachartikel in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 13.03.2025. Verfasst von Maria Teresa Colangelo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 95 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
We present an automated journal recommendation pipeline designed to evaluate the performance of five Sentence Transformer models—all-mpnet-base-v2 (Mpnet), all-MiniLM-L6-v2 (Minilm-l6), all-MiniLM-L12-v2 (Minilm-l12), multi-qa-distilbert-cos-v1 (Multi-qa-distilbert), and all-distilroberta-v1 (roberta)—for recommending journals aligned with a manuscript’s thematic scope. The pipeline extracts domain-relevant keywords from a manuscript via KeyBERT, retrieves potentially related articles from PubMed, and encodes both the test manuscript and retrieved articles into high-dimensional embeddings. By computing cosine similarity, it ranks relevant journals based on thematic overlap. Evaluations on 50 test articles highlight mpnet’s strong performance (mean similarity score 0.71 ± 0.04), albeit with higher computational demands. Minilm-l12 and minilm-l6 offer comparable precision at lower cost, while multi-qa-distilbert and roberta yield broader recommendations better suited to interdisciplinary research. These findings underscore key trade-offs among embedding models and demonstrate how they can provide interpretable, data-driven insights to guide journal selection across varied research contexts.
Zitieren
APA
Colangelo, M. T., Meleti, M., Guizzardi, S., Calciolari, E., & Galli, C. (2025). A Comparative Analysis of Sentence Transformer Models for Automated Journal Recommendation Using PubMed Metadata. Big Data and Cognitive Computing, 9(3), 67. https://doi.org/10.3390/bdcc9030067
Vancouver
Colangelo MT, Meleti M, Guizzardi S, Calciolari E, Galli C. A Comparative Analysis of Sentence Transformer Models for Automated Journal Recommendation Using PubMed Metadata. Big Data and Cognitive Computing. 2025;9(3):67. doi:10.3390/bdcc9030067
BibTeX
@article{Colangelo2025,
author = {Colangelo, Maria Teresa and Meleti, Marco and Guizzardi, Stefano and Calciolari, Elena and Galli, Carlo},
title = {A Comparative Analysis of Sentence Transformer Models for Automated Journal Recommendation Using PubMed Metadata},
journal = {Big Data and Cognitive Computing},
year = {2025},
volume = {9},
number = {3},
pages = {67},
doi = {10.3390/bdcc9030067}
}
EUVIMED