Direct Comparison Between Loss‐to‐Follow‐Up and Statistical Fragility Is Methodologically Inappropriate, and Fragility Reflects the P Value, Not Trial Robustness: A Simulation Analysis of 300,000 Randomized Controlled Trials
Direkter Vergleich zwischen Loss-to-Follow-up und statistischer Fragilität ist methodisch ungeeignet, und Fragilität spiegelt den P-Wert wider, nicht die Robustheit der Studie: Simulationsanalyse von 300.000 randomisierten kontrollierten Studien
Arthroscopy · 2026-11 · 42 (11) · 2749-2758
DOI: 10.1002/arj.70457 ↗Auf einen Blick
In 300.000 simulierten RCTs waren LTFI und R-LTFI häufiger größer als FI und RFI. Die Fragilitätsmaße wurden vor allem durch den P-Wert bestimmt.
Fragestellung
Wie hängen Fragility Index, Reverse Fragility Index und die minimale Zahl an Patient:innen, die für ein Umkehren der Signifikanz verloren gehen müssten, zusammen?
Methode
Simulation von 300.000 randomisierten kontrollierten Studien; Machine-Learning-Modelle zur Analyse der Einflussfaktoren auf Fragilitätsmaße.
Ergebnisse
In 100.000 Simulationen je Maß waren LTFI und R-LTFI in 84,9 % bzw. 95,5 % größer als FI und RFI. Der P-Wert erklärte 79,8 %, 71,9 % und 64,5 % der Varianz von FI, RFI und continuous fragility index.
Schlussfolgerung der Autor:innen
Fragilitätsmaße sind vor allem mathematische Ableitungen standardmäßiger Studienparameter und stark vom P-Wert geprägt. Direkte Vergleiche zwischen Fragilitätsmaßen und Lost-to-follow-up sind statistisch ungeeignet und sollten vermieden werden.
Kernaussagen
- LTFI und R-LTFI waren meist größer als FI und RFI
- Der P-Wert erklärte den größten Teil der Varianz
- Vergleiche mit Lost-to-follow-up sind statistisch ungeeignet
Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.
Kurz gefasst
Vergleichsstudie in der Zeitschrift Arthroscopy, online erschienen am 16.08.2026. Verfasst von Prushoth Vivekanantha und 7 weiteren Autor:innen. Beteiligte Einrichtung: Division of Orthopaedic Surgery, Department of Surgery, McMaster University, Hamilton, Canada. Hauptthemen laut MEDLINE: Randomized Controlled Trials as Topic, Lost to Follow-Up. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Purpose
To assess the relation between the fragility index (FI) and reverse fragility index (RFI) with the minimum number of patients needed to reverse statistical significance (e.g. henceforth termed the lost to follow‐up index (LTFI) and reverse LTFI (R‐LTFI), respectively) and apply machine learning to identify which trial parameters are most important in FI, RFI, and continuous fragility index composition given the nonlinearity of these metrics.
Methods
A total of 300,000 randomized controlled trials (100,000 for each metric) were simulated using common trial parameter value ranges. For FI and RFI, LTFI and R‐LTFI values, respectively, were calculated as the minimum number of patients lost to follow‐up to reverse significance in either direction. Machine learning models were trained to assess the relative importance of P value, sample size, and event numbers in FI and RFI composition and P value, group means, group standard deviations, and group sizes for continuous fragility index composition.
Results
Among their respective cohorts of 100,000, the LTFI and R‐LTFI were greater than FI and RFI in 84.9% and 95.5% of simulated randomized controlled trials, respectively. Random Forest and XGBoost machine learning models had near perfect accuracy in modeling fragility metrics (R 2 ≥ 0.98), justifying its use over standard linear regression models in identifying trial parameters that are most important in determining fragility values. Feature importance analysis showed that the P value accounted for 79.8%, 71.9%, and 64.5% of variability in FI, RFI, and continuous fragility index values.
Conclusions
Fragility metrics are primarily mathematical reflections of standard trial parameters and are heavily driven by the P value. Direct comparisons between fragility metrics and lost to follow‐up are statistically inappropriate because LTFI and R‐LTFI routinely exceed FI and RFI, respectively, and should be avoided in future fragility‐based studies. Clinical Relevance Understanding that statistical fragility metrics are mathematical transformations of trial parameters, and not independent measures of robustness, can prevent trial misinterpretation. Additionally, recognizing that the number of patients required to be lost to follow‐up to reverse trial significance often exceeds fragility metrics should discourage inappropriate comparisons in future orthopaedic research.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Division of Orthopaedic Surgery, Department of Surgery, McMaster University, Hamilton, Canada.
- Michael DeGroote School of Medicine, McMaster University, Hamilton, Canada.
- Department of Health Research Methods, Evidence & Impact, Department of Surgery, McMaster University, Hamilton, Canada.
ORCID-Profile: Prushoth Vivekanantha, Helena Son, Jeffrey Kay, Marc Daniel Bouchard, Kim Madden, Olufemi R Ayeni
Zitieren
APA
Vivekanantha, P., Son, H., Kay, J., Kotipalli, S., Bouchard, M. D., Madden, K., Simunovic, N., & Ayeni, O. R. (2026). Direct Comparison Between Loss‐to‐Follow‐Up and Statistical Fragility Is Methodologically Inappropriate, and Fragility Reflects the P Value, Not Trial Robustness: A Simulation Analysis of 300,000 Randomized Controlled Trials. Arthroscopy, 42(11), 2749-2758. https://doi.org/10.1002/arj.70457
Vancouver
Vivekanantha P, Son H, Kay J, Kotipalli S, Bouchard MD, Madden K, et al. Direct Comparison Between Loss‐to‐Follow‐Up and Statistical Fragility Is Methodologically Inappropriate, and Fragility Reflects the P Value, Not Trial Robustness: A Simulation Analysis of 300,000 Randomized Controlled Trials. Arthroscopy. 2026;42(11):2749-2758. doi:10.1002/arj.70457
BibTeX
@article{Vivekanantha2026,
author = {Vivekanantha, Prushoth and Son, Helena and Kay, Jeffrey and Kotipalli, Satyavenkata and Bouchard, Marc Daniel and Madden, Kim and Simunovic, Nicole and Ayeni, Olufemi R},
title = {Direct Comparison Between Loss‐to‐Follow‐Up and Statistical Fragility Is Methodologically Inappropriate, and Fragility Reflects the P Value, Not Trial Robustness: A Simulation Analysis of 300,000 Randomized Controlled Trials},
journal = {Arthroscopy},
year = {2026},
volume = {42},
number = {11},
pages = {2749--2758},
doi = {10.1002/arj.70457}
}
EUVIMED