EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

OD-MVSNet: Omni-dimensional dynamic multi-view stereo network

Ke Pan, Kefeng Li, Guangyuan Zhang iD, Zhenfang Zhu, Peng Wang, Zhenfei Wang, Chen Fu, Guangchen Li, Yuxuan Ding

PLOS ONE · 2024

DOI: 10.1371/journal.pone.0309029 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Ke Pan und 8 weiteren Autor:innen. Beteiligte Einrichtung: College of Information Science and Electrical Engineering, Shandong Jiaotong University, Jinan, Shandong, China. Hauptthemen laut MEDLINE: Imaging, Three-Dimensional. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Shandong Province.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-view stereo based on learning is a critical task in three-dimensional reconstruction, enabling the effective inference of depth maps and the reconstruction of fine-grained scene geometry. However, the results obtained by current popular 3D reconstruction methods are not precise, and achieving high-accuracy scene reconstruction remains challenging due to the pervasive impact of feature extraction and the poor correlation between cost and volume. In addressing these issues, we propose a cascade deep residual inference network to enhance the efficiency and accuracy of multi-view stereo depth estimation. This approach builds a cost-volume pyramid from coarse to fine, generating a lightweight, compact network to improve reconstruction results. Specifically, we introduce the omni-dimensional dynamic atrous spatial pyramid pooling (OSPP), a multiscale feature extraction module capable of generating dense feature maps with multiscale contextual information. The feature maps encoded by the OSPP module can generate dense point clouds without consuming significant memory. Furthermore, to alleviate the issue of feature mismatch in cost volume regularization, we propose a normalization-based 3D attention module. The 3D attention module aggregates crucial information within the cost volume across the dimensions of channel, spatial, and depth. Through extensive experiments on benchmark datasets, notably DTU, we found that the OD-MVSNet model outperforms the baseline model by approximately 1.4% in accuracy loss, 0.9% in completeness loss, and 1.2% in overall loss, demonstrating the effectiveness of our module.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Imaging, Three-DimensionalAlgorithmsNeural Networks, ComputerImage Processing, Computer-AssistedHumans

Autor:innen und Institutionen

  • College of Information Science and Electrical Engineering, Shandong Jiaotong University, Jinan, Shandong, China.
  • Shandong Zhengyuan Yeda Environmental Technology Co., Ltd., Jinan, Shandong, China.

ORCID-Profile: Guangyuan Zhang

Förderung

  • Natural Science Foundation of Shandong Province

Zitieren

APA

Pan, K., Li, K., Zhang, G., Zhu, Z., Wang, P., Wang, Z., Fu, C., Li, G., & Ding, Y. (2024). OD-MVSNet: Omni-dimensional dynamic multi-view stereo network. PLOS ONE. https://doi.org/10.1371/journal.pone.0309029

Vancouver

Pan K, Li K, Zhang G, Zhu Z, Wang P, Wang Z, et al. OD-MVSNet: Omni-dimensional dynamic multi-view stereo network. PLOS ONE. 2024. doi:10.1371/journal.pone.0309029

BibTeX
@article{Pan2024,
  author = {Pan, Ke and Li, Kefeng and Zhang, Guangyuan and Zhu, Zhenfang and Wang, Peng and Wang, Zhenfei and Fu, Chen and Li, Guangchen and Ding, Yuxuan},
  title = {OD-MVSNet: Omni-dimensional dynamic multi-view stereo network},
  journal = {PLOS ONE},
  year = {2024},
  doi = {10.1371/journal.pone.0309029}
}
Kostenlos starten →