EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Building a Multi-Sensor Lab for Interactive Communication Research: Challenges, Workarounds, and Lessons Learned

Ronny Kurniawan Ibrahim iD, Kelly Miles, Lisa Maggs, Brooke Luthy iD, Alan Kan, Michael J Richardson, Julian Maclaren, Simon Carlile iD, Zachary M Smith iD, Joerg M Buchholz

Trends in Hearing · 2026-01 · 30

DOI: 10.1177/23312165261470622 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Trends in Hearing, online erschienen am 21.07.2026. Verfasst von Ronny Kurniawan Ibrahim und 9 weiteren Autor:innen. Beteiligte Einrichtung: ECHO Laboratory, Macquarie University Hearing Research Centre, Sydney, NSW, Australia. Hauptthemen laut MEDLINE: Acoustics, Communication Devices for People with Disabilities. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: New South Wales Smart Sensing Network, Australian Future Hearing Initiative, Macquarie University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Designing multi-sensor experiments to study interactive communication is costly, complex, and often poorly documented, particularly in terms of implementation challenges and the rationale behind decision-making. Here, we aim to demystify the process by detailing the development of a custom multi-sensor lab designed to monitor comprehensive behavioural and physiological responses during interactive communication. To illustrate the system architecture, we use an implemented paradigm as a worked example: two adults engaged in natural conversation while listening to realistic background noise scenes delivered via open Sennheiser HD-800 headphones. Multi-sensor data were collected using DPA headset microphones, Tobii Pro Glasses 3, a Vicon motion capture system (with Tobii integration), BIOPAC amplifiers (PPG, EDA, ECG, respiration, temperature), a Fitbit Sense 2 smartwatch, and six Logitech BRIO 4K ultra HD video cameras recording via Open Broadcaster Software (OBS). Due to high bandwidth demands and varying sampling rates (1 Hz to 48 kHz) among the different devices, all systems recorded independently which posed a significant synchronisation challenge. A central RME soundcard delivered trigger pulses to the Tobii, BIOPAC, OBS, and Vicon systems to mark stimulus onset/offset. Redundant synchronisation mechanisms were implemented to mitigate the risk of trigger failure and bespoke processing pipelines were developed to synchronise data streams. We share key challenges and creative solutions encountered in building such a lab, to help researchers understand and anticipate common pain points and make more informed decisions when implementing their own multi-sensor setups.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AcousticsCommunication Devices for People with DisabilitiesHumansEquipment DesignSignal Processing, Computer-AssistedNoiseAcoustic StimulationVideo RecordingAdult

Stichwörter der Autor:innen

communication researchdevice integrationmulti-sensor experiment

Autor:innen und Institutionen

  • ECHO Laboratory, Macquarie University Hearing Research Centre, Sydney, NSW, Australia.
  • Performance and Expertise Research Centre, Macquarie University, Sydney, NSW, Australia.
  • School of Engineering, Macquarie University, Sydney, NSW, Australia.
  • Google Research, Sydney, NSW, Australia.
  • Cochlear Limited, Sydney, NSW, Australia.

ORCID-Profile: Ronny Kurniawan Ibrahim, Brooke Luthy, Simon Carlile, Zachary M Smith

Förderung

  • New South Wales Smart Sensing Network
  • Australian Future Hearing Initiative
  • Macquarie University
  • Cochlear, Next Sense and the Shepherd Centre

Zitieren

APA

Ibrahim, R. K., Miles, K., Maggs, L., Luthy, B., Kan, A., Richardson, M. J., Maclaren, J., Carlile, S., Smith, Z. M., & Buchholz, J. M. (2026). Building a Multi-Sensor Lab for Interactive Communication Research: Challenges, Workarounds, and Lessons Learned. Trends in Hearing, 30. https://doi.org/10.1177/23312165261470622

Vancouver

Ibrahim RK, Miles K, Maggs L, Luthy B, Kan A, Richardson MJ, et al. Building a Multi-Sensor Lab for Interactive Communication Research: Challenges, Workarounds, and Lessons Learned. Trends in Hearing. 2026;30. doi:10.1177/23312165261470622

BibTeX
@article{Ibrahim2026,
  author = {Ibrahim, Ronny Kurniawan and Miles, Kelly and Maggs, Lisa and Luthy, Brooke and Kan, Alan and Richardson, Michael J and Maclaren, Julian and Carlile, Simon and Smith, Zachary M and Buchholz, Joerg M},
  title = {Building a Multi-Sensor Lab for Interactive Communication Research: Challenges, Workarounds, and Lessons Learned},
  journal = {Trends in Hearing},
  year = {2026},
  volume = {30},
  doi = {10.1177/23312165261470622}
}
Kostenlos starten →