SLAM-Based Joint Calibration of Multiple Asynchronous Microphone Arrays and Sound Source Localization
IEEE Transactions on Robotics · 2024 · 40 · 4024-4044
DOI: 10.1109/tro.2024.3410456 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Robotics, 2024. Verfasst von Jiang Wang und 8 weiteren Autor:innen. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: Science, Technology, and Innovation Commission of Shenzhen Municipality, China, Shenzhen Science and Technology Program, National Natural Science Foundation of China.
Abstract (Originalsprache)
Robot audition systems with multiple microphone arrays have many applications in practice. However, the accurate calibration of multiple microphone arrays remains challenging because there are many unknown parameters to be identified, including the relative transforms (i.e., orientation and translation) and asynchronous factors (i.e., initial time offset and sampling clock difference) between microphone arrays. To tackle these challenges, in this article, we adopt batch simultaneous localization and mapping (SLAM) for joint calibration of multiple asynchronous microphone arrays and sound source localization. Using the Fisher information matrix (FIM) approach, we first conduct the observability analysis (i.e., parameter identifiability) of the abovementioned calibration problem and establish necessary/sufficient conditions under which the FIM and the Jacobian matrix have full column rank, which implies the identifiability of the unknown parameters. We also discover several scenarios where the unknown parameters are not uniquely identifiable. Subsequently, we propose an effective framework to initialize the unknown parameters, which is used as the initial guess in batch SLAM for multiple microphone array calibration, aiming to further enhance optimization accuracy and convergence. Extensive numerical simulations and real experiments have been conducted to verify the performance of the proposed method. The experimental results show that the proposed pipeline achieves higher accuracy with fast convergence in comparison to methods that use the noise-corrupted ground truth of the unknown parameters as the initial guess in the optimization and other existing frameworks.
Förderung
- Science, Technology, and Innovation Commission of Shenzhen Municipality, China
- Shenzhen Science and Technology Program
- National Natural Science Foundation of China
Zitieren
APA
Wang, J., He, Y., Su, D., Itoyama, K., Nakadai, K., Wu, J., Huang, S., Li, Y., & Kong, H. (2024). SLAM-Based Joint Calibration of Multiple Asynchronous Microphone Arrays and Sound Source Localization. IEEE Transactions on Robotics, 40, 4024-4044. https://doi.org/10.1109/tro.2024.3410456
Vancouver
Wang J, He Y, Su D, Itoyama K, Nakadai K, Wu J, et al. SLAM-Based Joint Calibration of Multiple Asynchronous Microphone Arrays and Sound Source Localization. IEEE Transactions on Robotics. 2024;40:4024-4044. doi:10.1109/tro.2024.3410456
BibTeX
@article{Wang2024,
author = {Wang, Jiang and He, Yuanzheng and Su, Daobilige and Itoyama, Katsutoshi and Nakadai, Kazuhiro and Wu, Junfeng and Huang, Shoudong and Li, Youfu and Kong, He},
title = {SLAM-Based Joint Calibration of Multiple Asynchronous Microphone Arrays and Sound Source Localization},
journal = {IEEE Transactions on Robotics},
year = {2024},
volume = {40},
pages = {4024--4044},
doi = {10.1109/tro.2024.3410456}
}
EUVIMED