EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Can Occupational Safety Practitioners Trust AI-Ranked Risk Factors? A Synthetic Study of Predictive Performance and Explanation Fidelity

Raúl Aguilar-Elena, Ana Delgado-García, Rubén Tino-Ramos, Alejandro Guillén-Riquelme, Juan José Agún-González

Safety · 12.11.2026 · 12 (6) · 148

DOI: 10.3390/safety12060148 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Safety, online erschienen am 12.11.2026. Verfasst von Raúl Aguilar-Elena und 4 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Artificial intelligence tools are increasingly used in occupational safety to rank factors associated with incidents and to support decisions on training, supervision, inspection, and preventive resource allocation. We evaluated whether predictive performance and explanation fidelity remain aligned when events are rare, and predictors are correlated. A fully synthetic occupational system was generated with Safety Data Sheet competence, six Bloom’s Taxonomy dimensions, behavioral and organizational variables, and a simulated incident outcome. Random forests and ridge models were assessed for nested cross-validation discrimination and calibration; random forests were additionally evaluated using ablation, held-out marginal and conditional permutation feature importance, and matched oracle importance derived from the known data-generating mechanism. A 29-condition Monte Carlo experiment (58,000 random-forest fits) examined sample size, prevalence, effect magnitude, and predictor architecture. Under the baseline condition, mean AUC was 0.689, whereas oracle–model rank agreement was weak (Spearman ρ=0.048) and oracle top-1 recovery was 20.7%. A high-signal implementation check produced ρ=0.964, with 83.4% top-1 and 98.5% top-2 recovery, while a more intensive rare-event pipeline left top-1 recovery essentially unchanged at 20.3%. Conditional permutation importance, benchmarked against a matched conditional oracle, reduced spurious first-ranking of true-null controls (26.9% to 22.9%, p

Zitieren

APA

Aguilar-Elena, R., Delgado-García, A., Tino-Ramos, R., Guillén-Riquelme, A., & Agún-González, J. J. (2026). Can Occupational Safety Practitioners Trust AI-Ranked Risk Factors? A Synthetic Study of Predictive Performance and Explanation Fidelity. Safety, 12(6), 148. https://doi.org/10.3390/safety12060148

Vancouver

Aguilar-Elena R, Delgado-García A, Tino-Ramos R, Guillén-Riquelme A, Agún-González JJ. Can Occupational Safety Practitioners Trust AI-Ranked Risk Factors? A Synthetic Study of Predictive Performance and Explanation Fidelity. Safety. 2026;12(6):148. doi:10.3390/safety12060148

BibTeX
@article{AguilarElena2026,
  author = {Aguilar-Elena, Raúl and Delgado-García, Ana and Tino-Ramos, Rubén and Guillén-Riquelme, Alejandro and Agún-González, Juan José},
  title = {Can Occupational Safety Practitioners Trust AI-Ranked Risk Factors? A Synthetic Study of Predictive Performance and Explanation Fidelity},
  journal = {Safety},
  year = {2026},
  volume = {12},
  number = {6},
  pages = {148},
  doi = {10.3390/safety12060148}
}
Kostenlos starten →