EUVIMEDEUVIMED entdecken
Crossref

Calibrated Semi-Supervised Models for Disaster Response based on Training Dynamics

Khushboo Gupta, Nikita Gautam, Tiberiu Sosea, Doina Caragea, Cornelia Caragea

Proceedings of the International ISCRAM Conference · 2025

DOI: 10.59297/5xkjq067 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the International ISCRAM Conference, 2025. Verfasst von Khushboo Gupta und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Despite advancements in semi-supervised learning (SSL) techniques that can be used when labeled data is limited, many SSL approaches still face challenges related to miscalibration. Calibration is crucial for ensuring the accuracy, reliability, and robustness of uncertainty estimates. In this work, we analyze the calibration performance of various SSL methods in the disaster response domain. Our results show that traditional self-training (ST) and mixup-based SSL methods often suffer from high Expected Calibration Error (ECE) despite achieving competitive F1 scores. In contrast, a newly introduced approach in the disaster domain, AUM-ST-Mixup, significantly improves calibration, achieving the lowest ECE across all settings. This improvement suggests that incorporating uncertainty-awareselection via Area Under the Margin (AUM) alongside mixup regularization enhances both predictive performance and model confidence alignment. Our findings highlight the importance of calibration-aware SSL methods, paving the way for more trustworthy model predictions in low-resource settings.

Zitieren

APA

Gupta, K., Gautam, N., Sosea, T., Caragea, D., & Caragea, C. (2025). Calibrated Semi-Supervised Models for Disaster Response based on Training Dynamics. Proceedings of the International ISCRAM Conference. https://doi.org/10.59297/5xkjq067

Vancouver

Gupta K, Gautam N, Sosea T, Caragea D, Caragea C. Calibrated Semi-Supervised Models for Disaster Response based on Training Dynamics. Proceedings of the International ISCRAM Conference. 2025. doi:10.59297/5xkjq067

BibTeX
@article{Gupta2025,
  author = {Gupta, Khushboo and Gautam, Nikita and Sosea, Tiberiu and Caragea, Doina and Caragea, Cornelia},
  title = {Calibrated Semi-Supervised Models for Disaster Response based on Training Dynamics},
  journal = {Proceedings of the International ISCRAM Conference},
  year = {2025},
  doi = {10.59297/5xkjq067}
}
Kostenlos starten →