EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Explosion of formulaic research articles, including inappropriate study designs and false discoveries, based on the NHANES US national health database

Tulsi Suchak, Anietie E Aliu, Charlie Harrison, Reyer Zwiggelaar, Nophar Geifman, Matt Spick iD

PLOS Biology · 2025-05-08 · 23 (5) · e3003152

DOI: 10.1371/journal.pbio.3003152 ↗

At a glance

Journal article in PLOS Biology, published online on 2025-05-08. Written by Tulsi Suchak and 5 co-authors. Institution: School of Health Sciences, Faculty of Health and Medical Sciences, University of Surrey, Guildford, United Kingdom. Major MEDLINE topics: Nutrition Surveys, Research Design. Cited 100 times so far (Crossref); 39 references. The full text is freely available (open access, CC BY 4.0). Funded by: Biotechnology and Biological Sciences Research Council.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

With the growth of artificial intelligence (AI)-ready datasets such as the National Health and Nutrition Examination Survey (NHANES), new opportunities for data-driven research are being created, but also generating risks of data exploitation by paper mills. In this work, we focus on two areas of potential concern for AI-supported research efforts. First, we describe the production of large numbers of formulaic single-factor analyses, relating single predictors to specific health conditions, where multifactorial approaches would be more appropriate. Employing AI-supported single-factor approaches removes context from research, fails to capture interactions, avoids false discovery correction, and is an approach that can easily be adopted by paper mills. Second, we identify risks of selective data usage, such as analyzing limited date ranges or cohort subsets without clear justification, suggestive of data dredging, and post-hoc hypothesis formation. Using a systematic literature search for single-factor analyses, we identified 341 NHANES-derived research papers published over the past decade, each proposing an association between a predictor and a health condition from the wide range contained within NHANES. We found evidence that research failed to take account of multifactorial relationships, that manuscripts did not account for the risks of false discoveries, and that researchers selectively extracted data from NHANES rather than utilizing the full range of data available. Given the explosion of AI-assisted productivity in published manuscripts (the systematic search strategy used here identified an average of 4 papers per annum from 2014 to 2021, but 190 in 2024–9 October alone), we highlight a set of best practices to address these concerns, aimed at researchers, data controllers, publishers, and peer reviewers, to encourage improved statistical practices and mitigate the risks of paper mills using AI-assisted workflows to introduce low-quality manuscripts to the scientific literature.

Subjects

MeSH terms (MEDLINE)

Nutrition SurveysResearch DesignUnited StatesHumansDatabases, FactualArtificial Intelligence

Authors and institutions

  • School of Health Sciences, Faculty of Health and Medical Sciences, University of Surrey, Guildford, United Kingdom.
  • Department of Computer Science, Aberystwyth University, Ceredigion, United Kingdom.

ORCID profiles: Matt Spick

Funding

  • Biotechnology and Biological Sciences Research Council

Cite

APA

Suchak, T., Aliu, A. E., Harrison, C., Zwiggelaar, R., Geifman, N., & Spick, M. (2025). Explosion of formulaic research articles, including inappropriate study designs and false discoveries, based on the NHANES US national health database. PLOS Biology, 23(5), e3003152. https://doi.org/10.1371/journal.pbio.3003152

Vancouver

Suchak T, Aliu AE, Harrison C, Zwiggelaar R, Geifman N, Spick M. Explosion of formulaic research articles, including inappropriate study designs and false discoveries, based on the NHANES US national health database. PLOS Biology. 2025;23(5):e3003152. doi:10.1371/journal.pbio.3003152

BibTeX
@article{Suchak2025,
  author = {Suchak, Tulsi and Aliu, Anietie E and Harrison, Charlie and Zwiggelaar, Reyer and Geifman, Nophar and Spick, Matt},
  title = {Explosion of formulaic research articles, including inappropriate study designs and false discoveries, based on the NHANES US national health database},
  journal = {PLOS Biology},
  year = {2025},
  volume = {23},
  number = {5},
  pages = {e3003152},
  doi = {10.1371/journal.pbio.3003152}
}
Start for free →