EUVIMEDEUVIMED entdecken
Crossref

Hierarchical Cross-Modal Fusion Model for Field Vehicle Classification

Jingzhi Zhang, Baoqing Li, Huawei Liu, Hongying Tang, Lijie Xia, Jingchang Huang

IEEE Transactions on Instrumentation and Measurement · 2026 · 75 · 9520515-9520515

DOI: 10.1109/tim.2026.3693447 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Instrumentation and Measurement, 2026. Verfasst von Jingzhi Zhang und 5 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Field vehicle classification is an important task for unattended ground sensor (UGS) systems. This article proposes a multimodal fusion-based classification method. Based on field measurement data collected in field environments, each signal sample contains continuous acoustic and seismic signals together with discrete image signals, which leads to information imbalance between the image modality and the acoustic–seismic modalities. To address this issue in multimodal fusion, a hierarchical cross-modal fusion (HCMF) method is proposed. First, shallow and deep convolutional features are extracted for each modality using a convolutional network. Subsequently, a two-level fusion strategy is performed using the proposed HCMF framework. In the first-level fusion, three intramodal transformer models are employed to fuse the two convolutional features within each modality, and the outputs of the three modalities are combined into a hybrid modality feature through confidence-weighted fusion. In the second-level fusion, an intermodal transformer model processes the hybrid modality feature to enable cross-modal information interaction, and the resulting representation is used for classification. Based on a small-scale dataset constructed from field measurement data, a series of experiments is conducted, including model generalization evaluation, ablation studies, modality absence analysis, and algorithm comparisons. Experimental results demonstrate that the proposed model exhibits generalization capability, achieving a macro $F1$ -score of 98.45% with 1.77 million parameters and 81.19 million FLOPs. The proposed method effectively balances classification performance and computational complexity, providing a potential solution for embedded applications in field vehicle classification.

Zitieren

APA

Zhang, J., Li, B., Liu, H., Tang, H., Xia, L., & Huang, J. (2026). Hierarchical Cross-Modal Fusion Model for Field Vehicle Classification. IEEE Transactions on Instrumentation and Measurement, 75, 9520515-9520515. https://doi.org/10.1109/tim.2026.3693447

Vancouver

Zhang J, Li B, Liu H, Tang H, Xia L, Huang J. Hierarchical Cross-Modal Fusion Model for Field Vehicle Classification. IEEE Transactions on Instrumentation and Measurement. 2026;75:9520515-9520515. doi:10.1109/tim.2026.3693447

BibTeX
@article{Zhang2026,
  author = {Zhang, Jingzhi and Li, Baoqing and Liu, Huawei and Tang, Hongying and Xia, Lijie and Huang, Jingchang},
  title = {Hierarchical Cross-Modal Fusion Model for Field Vehicle Classification},
  journal = {IEEE Transactions on Instrumentation and Measurement},
  year = {2026},
  volume = {75},
  pages = {9520515--9520515},
  doi = {10.1109/tim.2026.3693447}
}
Kostenlos starten →