EUVIMEDEUVIMED entdecken
Crossref

SLAM-Based Joint Calibration of Multiple Asynchronous Microphone Arrays and Sound Source Localization

Jiang Wang, Yuanzheng He, Daobilige Su, Katsutoshi Itoyama, Kazuhiro Nakadai, Junfeng Wu, Shoudong Huang, Youfu Li, He Kong

IEEE Transactions on Robotics · 2024 · 40 · 4024-4044

DOI: 10.1109/tro.2024.3410456 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Robotics, 2024. Verfasst von Jiang Wang und 8 weiteren Autor:innen. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: Science, Technology, and Innovation Commission of Shenzhen Municipality, China, Shenzhen Science and Technology Program, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Robot audition systems with multiple microphone arrays have many applications in practice. However, the accurate calibration of multiple microphone arrays remains challenging because there are many unknown parameters to be identified, including the relative transforms (i.e., orientation and translation) and asynchronous factors (i.e., initial time offset and sampling clock difference) between microphone arrays. To tackle these challenges, in this article, we adopt batch simultaneous localization and mapping (SLAM) for joint calibration of multiple asynchronous microphone arrays and sound source localization. Using the Fisher information matrix (FIM) approach, we first conduct the observability analysis (i.e., parameter identifiability) of the abovementioned calibration problem and establish necessary/sufficient conditions under which the FIM and the Jacobian matrix have full column rank, which implies the identifiability of the unknown parameters. We also discover several scenarios where the unknown parameters are not uniquely identifiable. Subsequently, we propose an effective framework to initialize the unknown parameters, which is used as the initial guess in batch SLAM for multiple microphone array calibration, aiming to further enhance optimization accuracy and convergence. Extensive numerical simulations and real experiments have been conducted to verify the performance of the proposed method. The experimental results show that the proposed pipeline achieves higher accuracy with fast convergence in comparison to methods that use the noise-corrupted ground truth of the unknown parameters as the initial guess in the optimization and other existing frameworks.

Förderung

  • Science, Technology, and Innovation Commission of Shenzhen Municipality, China
  • Shenzhen Science and Technology Program
  • National Natural Science Foundation of China

Zitieren

APA

Wang, J., He, Y., Su, D., Itoyama, K., Nakadai, K., Wu, J., Huang, S., Li, Y., & Kong, H. (2024). SLAM-Based Joint Calibration of Multiple Asynchronous Microphone Arrays and Sound Source Localization. IEEE Transactions on Robotics, 40, 4024-4044. https://doi.org/10.1109/tro.2024.3410456

Vancouver

Wang J, He Y, Su D, Itoyama K, Nakadai K, Wu J, et al. SLAM-Based Joint Calibration of Multiple Asynchronous Microphone Arrays and Sound Source Localization. IEEE Transactions on Robotics. 2024;40:4024-4044. doi:10.1109/tro.2024.3410456

BibTeX
@article{Wang2024,
  author = {Wang, Jiang and He, Yuanzheng and Su, Daobilige and Itoyama, Katsutoshi and Nakadai, Kazuhiro and Wu, Junfeng and Huang, Shoudong and Li, Youfu and Kong, He},
  title = {SLAM-Based Joint Calibration of Multiple Asynchronous Microphone Arrays and Sound Source Localization},
  journal = {IEEE Transactions on Robotics},
  year = {2024},
  volume = {40},
  pages = {4024--4044},
  doi = {10.1109/tro.2024.3410456}
}
Kostenlos starten →