EUVIMEDEUVIMED entdecken
Crossref

Multiple Adverse Weather Conditions Adaptation for Object Detection via Causal Intervention

Hua Zhang, Liqiang Xiao, Xiaochun Cao, Hassan Foroosh

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-03 · 46 (3) · 1742-1756

DOI: 10.1109/tpami.2022.3166765 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-03. Verfasst von Hua Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 67-mal zitiert (Crossref) und nennt 85 Literaturangaben. Gefördert von: National Key R&D Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Most state-of-the-art object detection methods have achieved impressive perfomrace on several public benchmarks, which are trained with high definition images. However, existing detectors are often sensitive to the visual variations and out-of-distribution data due to the domain gap caused by various confounders, e.g. the adverse weathre conditions. To bridge the gap, previous methods have been mainly exploring domain alignment, which requires to collect an amount of domain-specific training samples. In this paper, we introduce a novel domain adaptation model to discover a weather condition invariant feature representation. Specifically, we first employ a memory network to develop a confounder dictionary, which stores prototypes of object features under various scenarios. To guarantee the representativeness of each prototype in the dictionary, a dynamic item extraction strategy is used to update the memory dictionary. After that, we introduce a causal intervention reasoning module to explore the invariant representation of a specific object under different weather conditions. Finally, a categorical consistency regularization is used to constrain the similarities between categories in order to automatically search for the aligned instances among distinct domains. Experiments are conducted on several public benchmarks (RTTS, Foggy-Cityscapes, RID, and BDD 100K) with state-of-the-art performance achieved under multiple weather conditions.

Förderung

  • National Key R&D Program of China

Zitieren

APA

Zhang, H., Xiao, L., Cao, X., & Foroosh, H. (2024). Multiple Adverse Weather Conditions Adaptation for Object Detection via Causal Intervention. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(3), 1742-1756. https://doi.org/10.1109/tpami.2022.3166765

Vancouver

Zhang H, Xiao L, Cao X, Foroosh H. Multiple Adverse Weather Conditions Adaptation for Object Detection via Causal Intervention. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(3):1742-1756. doi:10.1109/tpami.2022.3166765

BibTeX
@article{Zhang2024,
  author = {Zhang, Hua and Xiao, Liqiang and Cao, Xiaochun and Foroosh, Hassan},
  title = {Multiple Adverse Weather Conditions Adaptation for Object Detection via Causal Intervention},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2024},
  volume = {46},
  number = {3},
  pages = {1742--1756},
  doi = {10.1109/tpami.2022.3166765}
}
Kostenlos starten →