EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Bridging the Validity Gap: Mitigating Strategic Overfitting in Management Analytics through Advanced Predictive Metrics

Richard Berimah Twum, Abdul Aziz Ibn Musah, Ernestina Hope Turkson

International Journal of Educational Innovations and Research · 06.03.2026 · 2 (1) · 01-11

DOI: 10.63671/ijeir.v2i1.81 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Educational Innovations and Research, online erschienen am 06.03.2026. Verfasst von Richard Berimah Twum und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose: In the age of data-driven management, leaders of organizations are relying more and more on structural models to predict the return on investments in knowledge. But there is a serious "validity gap": models with high explanatory power (R²) often don't accurately predict outcomes that weren't used to train the model, which can lead to strategic overfitting and decision risk. This study shows that advanced predictive metrics (Q² Predict, RMSE, and CVPAT) can be used to make diagnoses in Knowledge-Based Transformation Models (KBTM). Approach: We use Partial Least Squares Structural Equation Modelling (PLS-SEM) along with PLS-Predict and Cross-Validated Predictive Ability Testing (CVPAT) on a dataset of 310 banking professionals in Ghana. We look at how well the model predicts outcomes that weren't used to train it across nine multivariate constructs, separating internal knowledge processes from external performance outcomes. Findings: show that there is a lot of variation at the construct level. Knowledge-intensive processes, like Knowledge Creation (Q² = 0.834), are much better at predicting outcomes than naive benchmarks (p < 0.001). On the other hand, performance outcomes (like Employee Performance, Q² = 0.191) don't do a good job of predicting what will happen, which means that the model is very uncertain. Value: This study goes beyond traditional fit indices to create a set of rules for predictive validation in management analytics. We show that only using explanatory metrics hides "blind spots" in predicting performance. We suggest a framework for analytics maturity that encourages leaders to tell the difference between outcome variables that can change and process variables that can change before making strategic decisions.

Zitieren

APA

Twum, R. B., Musah, A. A. I., & Turkson, E. H. (2026). Bridging the Validity Gap: Mitigating Strategic Overfitting in Management Analytics through Advanced Predictive Metrics. International Journal of Educational Innovations and Research, 2(1), 01-11. https://doi.org/10.63671/ijeir.v2i1.81

Vancouver

Twum RB, Musah AAI, Turkson EH. Bridging the Validity Gap: Mitigating Strategic Overfitting in Management Analytics through Advanced Predictive Metrics. International Journal of Educational Innovations and Research. 2026;2(1):01-11. doi:10.63671/ijeir.v2i1.81

BibTeX
@article{Twum2026,
  author = {Twum, Richard Berimah and Musah, Abdul Aziz Ibn and Turkson, Ernestina Hope},
  title = {Bridging the Validity Gap: Mitigating Strategic Overfitting in Management Analytics through Advanced Predictive Metrics},
  journal = {International Journal of Educational Innovations and Research},
  year = {2026},
  volume = {2},
  number = {1},
  pages = {01--11},
  doi = {10.63671/ijeir.v2i1.81}
}
Kostenlos starten →