Hierarchical Cross-Modal Fusion Model for Field Vehicle Classification
IEEE Transactions on Instrumentation and Measurement · 2026 · 75 · 9520515-9520515
DOI: 10.1109/tim.2026.3693447 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Instrumentation and Measurement, 2026. Verfasst von Jingzhi Zhang und 5 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben.
Abstract (Originalsprache)
Field vehicle classification is an important task for unattended ground sensor (UGS) systems. This article proposes a multimodal fusion-based classification method. Based on field measurement data collected in field environments, each signal sample contains continuous acoustic and seismic signals together with discrete image signals, which leads to information imbalance between the image modality and the acoustic–seismic modalities. To address this issue in multimodal fusion, a hierarchical cross-modal fusion (HCMF) method is proposed. First, shallow and deep convolutional features are extracted for each modality using a convolutional network. Subsequently, a two-level fusion strategy is performed using the proposed HCMF framework. In the first-level fusion, three intramodal transformer models are employed to fuse the two convolutional features within each modality, and the outputs of the three modalities are combined into a hybrid modality feature through confidence-weighted fusion. In the second-level fusion, an intermodal transformer model processes the hybrid modality feature to enable cross-modal information interaction, and the resulting representation is used for classification. Based on a small-scale dataset constructed from field measurement data, a series of experiments is conducted, including model generalization evaluation, ablation studies, modality absence analysis, and algorithm comparisons. Experimental results demonstrate that the proposed model exhibits generalization capability, achieving a macro $F1$ -score of 98.45% with 1.77 million parameters and 81.19 million FLOPs. The proposed method effectively balances classification performance and computational complexity, providing a potential solution for embedded applications in field vehicle classification.
Zitieren
APA
Zhang, J., Li, B., Liu, H., Tang, H., Xia, L., & Huang, J. (2026). Hierarchical Cross-Modal Fusion Model for Field Vehicle Classification. IEEE Transactions on Instrumentation and Measurement, 75, 9520515-9520515. https://doi.org/10.1109/tim.2026.3693447
Vancouver
Zhang J, Li B, Liu H, Tang H, Xia L, Huang J. Hierarchical Cross-Modal Fusion Model for Field Vehicle Classification. IEEE Transactions on Instrumentation and Measurement. 2026;75:9520515-9520515. doi:10.1109/tim.2026.3693447
BibTeX
@article{Zhang2026,
author = {Zhang, Jingzhi and Li, Baoqing and Liu, Huawei and Tang, Hongying and Xia, Lijie and Huang, Jingchang},
title = {Hierarchical Cross-Modal Fusion Model for Field Vehicle Classification},
journal = {IEEE Transactions on Instrumentation and Measurement},
year = {2026},
volume = {75},
pages = {9520515--9520515},
doi = {10.1109/tim.2026.3693447}
}
EUVIMED