MFE-Net: A Multi-Layer Feature Extraction Network for No-Reference Quality Assessment of 3-D Point Clouds
IEEE Transactions on Broadcasting · 2024-03 · 70 (1) · 265-277
DOI: 10.1109/tbc.2023.3311339 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Broadcasting, 2024-03. Verfasst von Qihao Liang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Zhejiang Natural Science Foundation of China, Ningbo Natural Science Foundation of China.
Abstract (Originalsprache)
As an important data form, the point cloud (PC) can present real-world objects in a 3D and realistic way. In order to measure the performance of acquisition, processing, and compression systems, it is crucial to propose a PC quality assessment (PCQA) method. Nowadays, a lot of full-reference PCQA methods have been developed, but it is obviously difficult to have wide applications. Usually, we should complete PCQA tasks without the original PC, so a no-reference PCQA method based on deep learning is proposed in this paper, which is consisting of adaptive feature extraction (AFE) module, local quality acquisition (LQA) module, and global quality acquisition (GQA) module. Specifically, MFE-Net is the core of the LQA module that combines a feature fusion mechanism with hierarchical feature extraction module and regression module, and makes full use of different hierarchical features. Besides, in the AFE module, hand-crafted features are extracted from local sampling clusters of distorted PCs by an adaptive approach, including the distance from the sampling center point, mean curvature, and gray level of the point, to replace the PC as the input of MFE-Net. Afterward, deep features can be learned based on such hand-crafted features to predict the local quality score, and the global quality can be obtained through aggregation in the GQA module. Experimental results on the two publicly available subjective datasets, SJTU-PCQA and CPCD2.0 show that the performance of the proposed method is superior to state-of-the-art PCQA methods.
Förderung
- National Natural Science Foundation of China
- Zhejiang Natural Science Foundation of China
- Ningbo Natural Science Foundation of China
- Zhejiang Province Education Department Foundation
- Zhejiang Provincial Postdoctoral Research Excellence Foundation
Zitieren
APA
Liang, Q., He, Z., Yu, M., Luo, T., & Xu, H. (2024). MFE-Net: A Multi-Layer Feature Extraction Network for No-Reference Quality Assessment of 3-D Point Clouds. IEEE Transactions on Broadcasting, 70(1), 265-277. https://doi.org/10.1109/tbc.2023.3311339
Vancouver
Liang Q, He Z, Yu M, Luo T, Xu H. MFE-Net: A Multi-Layer Feature Extraction Network for No-Reference Quality Assessment of 3-D Point Clouds. IEEE Transactions on Broadcasting. 2024;70(1):265-277. doi:10.1109/tbc.2023.3311339
BibTeX
@article{Liang2024,
author = {Liang, Qihao and He, Zhouyan and Yu, Mei and Luo, Ting and Xu, Haiyong},
title = {MFE-Net: A Multi-Layer Feature Extraction Network for No-Reference Quality Assessment of 3-D Point Clouds},
journal = {IEEE Transactions on Broadcasting},
year = {2024},
volume = {70},
number = {1},
pages = {265--277},
doi = {10.1109/tbc.2023.3311339}
}
EUVIMED