Deep learning-enabled 3D multimodal fusion of cone-beam CT and intraoral mesh scans for clinically applicable tooth-bone reconstruction
Patterns · 2023-09 · 4 (9) · 100825
DOI: 10.1016/j.patter.2023.100825 ↗Kurz gefasst
Fachartikel in der Zeitschrift Patterns, 2023-09. Verfasst von Jiaxiang Liu und 10 weiteren Autor:innen. Beteiligte Einrichtung: Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Zhejiang Provincial Clinical Research Center for Oral Diseases, …. Die Arbeit wurde bisher 75-mal zitiert (Crossref) und nennt 78 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Zhejiang Province, Sichuan Province Science and Technology Support Program.
Abstract (Originalsprache)
High-fidelity three-dimensional (3D) models of tooth-bone structures are valuable for virtual dental treatment planning; however, they require integrating data from cone-beam computed tomography (CBCT) and intraoral scans (IOS) using methods that are either error-prone or time-consuming. Hence, this study presents Deep Dental Multimodal Fusion (DDMF), an automatic multimodal framework that reconstructs 3D tooth-bone structures using CBCT and IOS. Specifically, the DDMF framework comprises CBCT and IOS segmentation modules as well as a multimodal reconstruction module with novel pixel representation learning architectures, prior knowledge-guided losses, and geometry-based 3D fusion techniques. Experiments on real-world large-scale datasets revealed that DDMF achieved superior segmentation performance on CBCT and IOS, achieving a 0.17 mm average symmetric surface distance (ASSD) for 3D fusion with a substantial processing time reduction. Additionally, clinical applicability studies have demonstrated DDMF's potential for accurately simulating tooth-bone structures throughout the orthodontic treatment process.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Zhejiang Provincial Clinical Research Center for Oral Diseases, Hangzhou 310000, China.
- Zhejiang University-University of Illinois at Urbana-Champaign Institute, Zhejiang University, Haining 314400, China.
- College of Computer Science and Technology, Zhejiang University, Hangzhou 310058, China.
- State Key Laboratory of Oral Diseases & National Center for Stomatology & National Clinical Research Center for Oral Diseases & West China Hospital of Stomatology, Sichuan University, Chengdu 610041, China.
- Harvard School of Dental Medicine, Harvard University, Boston, MA 02115, USA.
- OPT Machine Vision Tech Co., Ltd., Tokyo 135-0064, Japan.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Zhejiang Province
- Sichuan Province Science and Technology Support Program
Zitieren
APA
Liu, J., Hao, J., Lin, H., Pan, W., Yang, J., Feng, Y., Wang, G., Li, J., Jin, Z., Zhao, Z., & Liu, Z. (2023). Deep learning-enabled 3D multimodal fusion of cone-beam CT and intraoral mesh scans for clinically applicable tooth-bone reconstruction. Patterns, 4(9), 100825. https://doi.org/10.1016/j.patter.2023.100825
Vancouver
Liu J, Hao J, Lin H, Pan W, Yang J, Feng Y, et al. Deep learning-enabled 3D multimodal fusion of cone-beam CT and intraoral mesh scans for clinically applicable tooth-bone reconstruction. Patterns. 2023;4(9):100825. doi:10.1016/j.patter.2023.100825
BibTeX
@article{Liu2023,
author = {Liu, Jiaxiang and Hao, Jin and Lin, Hangzheng and Pan, Wei and Yang, Jianfei and Feng, Yang and Wang, Gaoang and Li, Jin and Jin, Zuolin and Zhao, Zhihe and Liu, Zuozhu},
title = {Deep learning-enabled 3D multimodal fusion of cone-beam CT and intraoral mesh scans for clinically applicable tooth-bone reconstruction},
journal = {Patterns},
year = {2023},
volume = {4},
number = {9},
pages = {100825},
doi = {10.1016/j.patter.2023.100825}
}
EUVIMED