EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Comparative Analysis of Sentence Transformer Models for Automated Journal Recommendation Using PubMed Metadata

Maria Teresa Colangelo, Marco Meleti, Stefano Guizzardi, Elena Calciolari, Carlo Galli

Big Data and Cognitive Computing · 13.03.2025 · 9 (3) · 67

DOI: 10.3390/bdcc9030067 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 13.03.2025. Verfasst von Maria Teresa Colangelo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 95 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present an automated journal recommendation pipeline designed to evaluate the performance of five Sentence Transformer models—all-mpnet-base-v2 (Mpnet), all-MiniLM-L6-v2 (Minilm-l6), all-MiniLM-L12-v2 (Minilm-l12), multi-qa-distilbert-cos-v1 (Multi-qa-distilbert), and all-distilroberta-v1 (roberta)—for recommending journals aligned with a manuscript’s thematic scope. The pipeline extracts domain-relevant keywords from a manuscript via KeyBERT, retrieves potentially related articles from PubMed, and encodes both the test manuscript and retrieved articles into high-dimensional embeddings. By computing cosine similarity, it ranks relevant journals based on thematic overlap. Evaluations on 50 test articles highlight mpnet’s strong performance (mean similarity score 0.71 ± 0.04), albeit with higher computational demands. Minilm-l12 and minilm-l6 offer comparable precision at lower cost, while multi-qa-distilbert and roberta yield broader recommendations better suited to interdisciplinary research. These findings underscore key trade-offs among embedding models and demonstrate how they can provide interpretable, data-driven insights to guide journal selection across varied research contexts.

Zitieren

APA

Colangelo, M. T., Meleti, M., Guizzardi, S., Calciolari, E., & Galli, C. (2025). A Comparative Analysis of Sentence Transformer Models for Automated Journal Recommendation Using PubMed Metadata. Big Data and Cognitive Computing, 9(3), 67. https://doi.org/10.3390/bdcc9030067

Vancouver

Colangelo MT, Meleti M, Guizzardi S, Calciolari E, Galli C. A Comparative Analysis of Sentence Transformer Models for Automated Journal Recommendation Using PubMed Metadata. Big Data and Cognitive Computing. 2025;9(3):67. doi:10.3390/bdcc9030067

BibTeX
@article{Colangelo2025,
  author = {Colangelo, Maria Teresa and Meleti, Marco and Guizzardi, Stefano and Calciolari, Elena and Galli, Carlo},
  title = {A Comparative Analysis of Sentence Transformer Models for Automated Journal Recommendation Using PubMed Metadata},
  journal = {Big Data and Cognitive Computing},
  year = {2025},
  volume = {9},
  number = {3},
  pages = {67},
  doi = {10.3390/bdcc9030067}
}
Kostenlos starten →