Multiple Adverse Weather Conditions Adaptation for Object Detection via Causal Intervention
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-03 · 46 (3) · 1742-1756
DOI: 10.1109/tpami.2022.3166765 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-03. Verfasst von Hua Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 67-mal zitiert (Crossref) und nennt 85 Literaturangaben. Gefördert von: National Key R&D Program of China.
Abstract (Originalsprache)
Most state-of-the-art object detection methods have achieved impressive perfomrace on several public benchmarks, which are trained with high definition images. However, existing detectors are often sensitive to the visual variations and out-of-distribution data due to the domain gap caused by various confounders, e.g. the adverse weathre conditions. To bridge the gap, previous methods have been mainly exploring domain alignment, which requires to collect an amount of domain-specific training samples. In this paper, we introduce a novel domain adaptation model to discover a weather condition invariant feature representation. Specifically, we first employ a memory network to develop a confounder dictionary, which stores prototypes of object features under various scenarios. To guarantee the representativeness of each prototype in the dictionary, a dynamic item extraction strategy is used to update the memory dictionary. After that, we introduce a causal intervention reasoning module to explore the invariant representation of a specific object under different weather conditions. Finally, a categorical consistency regularization is used to constrain the similarities between categories in order to automatically search for the aligned instances among distinct domains. Experiments are conducted on several public benchmarks (RTTS, Foggy-Cityscapes, RID, and BDD 100K) with state-of-the-art performance achieved under multiple weather conditions.
Förderung
- National Key R&D Program of China
Zitieren
APA
Zhang, H., Xiao, L., Cao, X., & Foroosh, H. (2024). Multiple Adverse Weather Conditions Adaptation for Object Detection via Causal Intervention. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(3), 1742-1756. https://doi.org/10.1109/tpami.2022.3166765
Vancouver
Zhang H, Xiao L, Cao X, Foroosh H. Multiple Adverse Weather Conditions Adaptation for Object Detection via Causal Intervention. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(3):1742-1756. doi:10.1109/tpami.2022.3166765
BibTeX
@article{Zhang2024,
author = {Zhang, Hua and Xiao, Liqiang and Cao, Xiaochun and Foroosh, Hassan},
title = {Multiple Adverse Weather Conditions Adaptation for Object Detection via Causal Intervention},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2024},
volume = {46},
number = {3},
pages = {1742--1756},
doi = {10.1109/tpami.2022.3166765}
}
EUVIMED