Machine learning models can predict subsequent publication of North American Spine Society (NASS) annual general meeting abstracts
PLOS ONE · 22.08.2023 · 18 (8) · e0289931
DOI: 10.1371/journal.pone.0289931 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 22.08.2023. Verfasst von Aazad Abbas und 10 weiteren Autor:innen. Beteiligte Einrichtung: Division of Orthopaedic Surgery, University of Toronto, Toronto, ON, Canada. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background context Academic meetings serve as an opportunity to present and discuss novel ideas. Previous studies have identified factors predictive of publication without generating predictive models. Machine learning (ML) presents a novel tool capable of generating these models. As such, the objective of this study was to use ML models to predict subsequent publication of abstracts presented at a major surgical conference. Study design/setting Database study.
Methods
All abstracts from the North American Spine Society (NASS) annual general meetings (AGM) from 2013–2015 were reviewed. The following information was extracted: number of authors, institution, location, conference category, subject category, study type, data collection methodology, human subject research, and FDA approval. Abstracts were then searched on the PubMed, Google Scholar, and Scopus databases for publication. ML models were trained to predict whether the abstract would be published or not. Quality of models was determined by using the area under the receiver operator curve (AUC). The top ten most important factors were extracted from the most successful model during testing.
Results
A total of 1119 abstracts were presented, with 553 (49%) abstracts published. During training, the model with the highest AUC and accuracy metrics was the partial least squares (AUC of 0.77±0.05, accuracy of 75.5%±4.7%). During testing, the model with the highest AUC and accuracy was the random forest (AUC of 0.69, accuracy of 67%). The top ten features for the random forest model were (descending order): number of authors, year, conference category, subject category, human subjects research, continent, and data collection methodology.
Conclusions
This was the first study attempting to use ML to predict the publication of complete articles after abstract presentation at a major academic conference. Future studies should incorporate deep learning frameworks, cognitive/results-based variables and aim to apply this methodology to larger conferences across other fields of medicine to improve the quality of works presented.
Autor:innen und Institutionen
- Division of Orthopaedic Surgery, University of Toronto, Toronto, ON, Canada.
- Division of Orthopaedic Surgery, University of Western Ontario, London, ON, Canada.
- School of Medicine, St. George's University, University Centre, Grenada, West Indies.
- Division of Orthopaedic Surgery, Sunnybrook Health Science Centre, Toronto, ON, Canada.
- Division of Orthopaedic Surgery, St. Michael's Hospital, Toronto, ON, Canada.
- Division of Orthopaedic Surgery Toronto Western Hospital, Toronto, ON, Canada.
ORCID-Profile: Aazad Abbas, Denis Selimovic
Zitieren
APA
Abbas, A., Olotu, O., Bhatia, A., Selimovic, D., Tajik, A., Larouche, J., Ahn, H., Yee, A., Lewis, S., Finkelstein, J., & Toor, J. (2023). Machine learning models can predict subsequent publication of North American Spine Society (NASS) annual general meeting abstracts. PLOS ONE, 18(8), e0289931. https://doi.org/10.1371/journal.pone.0289931
Vancouver
Abbas A, Olotu O, Bhatia A, Selimovic D, Tajik A, Larouche J, et al. Machine learning models can predict subsequent publication of North American Spine Society (NASS) annual general meeting abstracts. PLOS ONE. 2023;18(8):e0289931. doi:10.1371/journal.pone.0289931
BibTeX
@article{Abbas2023,
author = {Abbas, Aazad and Olotu, Olumide and Bhatia, Akeshdeep and Selimovic, Denis and Tajik, Alireza and Larouche, Jeremie and Ahn, Henry and Yee, Albert and Lewis, Stephen and Finkelstein, Joel and Toor, Jay},
title = {Machine learning models can predict subsequent publication of North American Spine Society (NASS) annual general meeting abstracts},
journal = {PLOS ONE},
year = {2023},
volume = {18},
number = {8},
pages = {e0289931},
doi = {10.1371/journal.pone.0289931}
}
EUVIMED