EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

As good as it gets? A new approach to estimating possible prediction performance

David Anderson iD, Margret Bjarnadottir

PLOS ONE · 2024

DOI: 10.1371/journal.pone.0296904 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von David Anderson und 1 weiteren Autor:innen. Beteiligte Einrichtung: Villanova School of Business, Villanova, PA, United States of America. Hauptthemen laut MEDLINE: Models, Statistical. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

How much information does a dataset contain about an outcome of interest? To answer this question, estimates are generated for a given dataset, representing the minimum possible absolute prediction error for an outcome variable that any model could achieve. The estimate is produced using a constrained omniscient model that mandates only that identical observations receive identical predictions, and that observations which are very similar to each other receive predictions that are alike. It is demonstrated that the resulting prediction accuracy bounds function effectively on both simulated data and real-world datasets. This method generates bounds on predictive performance typically within 10% of the performance of the true model, and performs well across a range of simulated and real datasets. Three applications of the methodology are discussed: measuring data quality, model evaluation, and quantifying the amount of irreducible error in a prediction problem.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Models, StatisticalHumansData AccuracyAlgorithmsComputer SimulationModels, Theoretical

Autor:innen und Institutionen

  • Villanova School of Business, Villanova, PA, United States of America.
  • Robert H. Smith School of Business, University of Maryland, College Park, MD, United States of America.

ORCID-Profile: David Anderson

Zitieren

APA

Anderson, D., & Bjarnadottir, M. (2024). As good as it gets? A new approach to estimating possible prediction performance. PLOS ONE. https://doi.org/10.1371/journal.pone.0296904

Vancouver

Anderson D, Bjarnadottir M. As good as it gets? A new approach to estimating possible prediction performance. PLOS ONE. 2024. doi:10.1371/journal.pone.0296904

BibTeX
@article{Anderson2024,
  author = {Anderson, David and Bjarnadottir, Margret},
  title = {As good as it gets? A new approach to estimating possible prediction performance},
  journal = {PLOS ONE},
  year = {2024},
  doi = {10.1371/journal.pone.0296904}
}
Kostenlos starten →