Building a Multi-Sensor Lab for Interactive Communication Research: Challenges, Workarounds, and Lessons Learned
Trends in Hearing · 2026-01 · 30
DOI: 10.1177/23312165261470622 ↗Kurz gefasst
Fachartikel in der Zeitschrift Trends in Hearing, online erschienen am 21.07.2026. Verfasst von Ronny Kurniawan Ibrahim und 9 weiteren Autor:innen. Beteiligte Einrichtung: ECHO Laboratory, Macquarie University Hearing Research Centre, Sydney, NSW, Australia. Hauptthemen laut MEDLINE: Acoustics, Communication Devices for People with Disabilities. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: New South Wales Smart Sensing Network, Australian Future Hearing Initiative, Macquarie University.
Abstract (Originalsprache)
Designing multi-sensor experiments to study interactive communication is costly, complex, and often poorly documented, particularly in terms of implementation challenges and the rationale behind decision-making. Here, we aim to demystify the process by detailing the development of a custom multi-sensor lab designed to monitor comprehensive behavioural and physiological responses during interactive communication. To illustrate the system architecture, we use an implemented paradigm as a worked example: two adults engaged in natural conversation while listening to realistic background noise scenes delivered via open Sennheiser HD-800 headphones. Multi-sensor data were collected using DPA headset microphones, Tobii Pro Glasses 3, a Vicon motion capture system (with Tobii integration), BIOPAC amplifiers (PPG, EDA, ECG, respiration, temperature), a Fitbit Sense 2 smartwatch, and six Logitech BRIO 4K ultra HD video cameras recording via Open Broadcaster Software (OBS). Due to high bandwidth demands and varying sampling rates (1 Hz to 48 kHz) among the different devices, all systems recorded independently which posed a significant synchronisation challenge. A central RME soundcard delivered trigger pulses to the Tobii, BIOPAC, OBS, and Vicon systems to mark stimulus onset/offset. Redundant synchronisation mechanisms were implemented to mitigate the risk of trigger failure and bespoke processing pipelines were developed to synchronise data streams. We share key challenges and creative solutions encountered in building such a lab, to help researchers understand and anticipate common pain points and make more informed decisions when implementing their own multi-sensor setups.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- ECHO Laboratory, Macquarie University Hearing Research Centre, Sydney, NSW, Australia.
- Performance and Expertise Research Centre, Macquarie University, Sydney, NSW, Australia.
- School of Engineering, Macquarie University, Sydney, NSW, Australia.
- Google Research, Sydney, NSW, Australia.
- Cochlear Limited, Sydney, NSW, Australia.
ORCID-Profile: Ronny Kurniawan Ibrahim, Brooke Luthy, Simon Carlile, Zachary M Smith
Förderung
- New South Wales Smart Sensing Network
- Australian Future Hearing Initiative
- Macquarie University
- Cochlear, Next Sense and the Shepherd Centre
Zitieren
APA
Ibrahim, R. K., Miles, K., Maggs, L., Luthy, B., Kan, A., Richardson, M. J., Maclaren, J., Carlile, S., Smith, Z. M., & Buchholz, J. M. (2026). Building a Multi-Sensor Lab for Interactive Communication Research: Challenges, Workarounds, and Lessons Learned. Trends in Hearing, 30. https://doi.org/10.1177/23312165261470622
Vancouver
Ibrahim RK, Miles K, Maggs L, Luthy B, Kan A, Richardson MJ, et al. Building a Multi-Sensor Lab for Interactive Communication Research: Challenges, Workarounds, and Lessons Learned. Trends in Hearing. 2026;30. doi:10.1177/23312165261470622
BibTeX
@article{Ibrahim2026,
author = {Ibrahim, Ronny Kurniawan and Miles, Kelly and Maggs, Lisa and Luthy, Brooke and Kan, Alan and Richardson, Michael J and Maclaren, Julian and Carlile, Simon and Smith, Zachary M and Buchholz, Joerg M},
title = {Building a Multi-Sensor Lab for Interactive Communication Research: Challenges, Workarounds, and Lessons Learned},
journal = {Trends in Hearing},
year = {2026},
volume = {30},
doi = {10.1177/23312165261470622}
}
EUVIMED