EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

When Similar Models Disagree: Model Multiplicity and Geographic Robustness in School Meal Utilization Prediction

Amanatullah Pandu Zenklinov, Andriano Andriano, Wisnowan Hendy Saputra, Marcella Ariani, Nabilla Rida Tri Nisa, Sabrina Julietta Arisanty

Journal of Computing Theories and Applications · 10.11.2026 · 4 (2) · 769-789

DOI: 10.62411/jcta.18209 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computing Theories and Applications, online erschienen am 10.11.2026. Verfasst von Amanatullah Pandu Zenklinov und 5 weiteren Autor:innen. Die Arbeit nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Competing predictive models can achieve similar aggregate performance while producing different classifications and downstream conclusions for the same individuals. This model disagreement raises an important question about whether conventional performance metrics adequately capture the reliability of model-based analyses. This study investigates model-choice disagreement across multiple analytical layers using voluntary-response survey data from 8,802 respondents who reported receiving meals through Indonesia’s Free Nutritious Meals program. Logistic Regression (LR), Random Forest, and XGBoost were evaluated using a nested school-disjoint validation framework. All three models were compared in terms of discrimination and probability calibration, while the competitive models were further examined through high-risk classification, predictive attribution, model-based scenario analysis, and province-holdout robustness. LR and XGBoost achieved nearly identical PR-AUC values (0.7270 and 0.7277, respectively), with similarly close pooled PR-AUC under province holdout (0.7288 and 0.7285). Despite this aggregate similarity, the models assigned different high-risk classifications to 5.41% of respondents. Their scenario analyses also produced different threshold-crossing rates: 8.87% of eligible respondents under LR (382 of 4,307) and 6.66% under XGBoost. Random Forest exhibited weaker probability calibration in the fitted configuration and was not retained for downstream comparison. Overall, the findings reveal that model agreement at the population level does not necessarily extend to individual classifications and scenario outputs. LR was selected as the reference model through documented judgment considering predictive performance, calibration, robustness, parsimony, and interpretability. These results demonstrate the importance of evaluating model-choice robustness beyond conventional predictive performance metrics, particularly when model outputs inform downstream interpretation or classification.

Zitieren

APA

Zenklinov, A. P., Andriano, A., Saputra, W. H., Ariani, M., Nisa, N. R. T., & Arisanty, S. J. (2026). When Similar Models Disagree: Model Multiplicity and Geographic Robustness in School Meal Utilization Prediction. Journal of Computing Theories and Applications, 4(2), 769-789. https://doi.org/10.62411/jcta.18209

Vancouver

Zenklinov AP, Andriano A, Saputra WH, Ariani M, Nisa NRT, Arisanty SJ. When Similar Models Disagree: Model Multiplicity and Geographic Robustness in School Meal Utilization Prediction. Journal of Computing Theories and Applications. 2026;4(2):769-789. doi:10.62411/jcta.18209

BibTeX
@article{Zenklinov2026,
  author = {Zenklinov, Amanatullah Pandu and Andriano, Andriano and Saputra, Wisnowan Hendy and Ariani, Marcella and Nisa, Nabilla Rida Tri and Arisanty, Sabrina Julietta},
  title = {When Similar Models Disagree: Model Multiplicity and Geographic Robustness in School Meal Utilization Prediction},
  journal = {Journal of Computing Theories and Applications},
  year = {2026},
  volume = {4},
  number = {2},
  pages = {769--789},
  doi = {10.62411/jcta.18209}
}
Kostenlos starten →