Developing a user-centric interface for performer-aware automatic panning system
The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A433-A433
DOI: 10.1121/10.0041412 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Kangeun Lee und 1 weiteren Autor:innen.
Abstract (Originalsprache)
We previously proposed a video-based automatic audio panning system for music performance called Performer-Aware Automatic Panning System (PAAP). Building on this, we present two key extensions: (1) enhanced performance of the stage dimension estimation (SDE) model and (2) development of an intuitive graphical user interface (GUI). To improve SDE, we updated the training pipeline by replacing contour feature-based input data with monocular depth features, which led to more accurate dimension inference. Additionally, a user-centric interface was implemented so users can utilize PAAP in real-world scenarios. The GUI offers the following: (1) loading a front-view stage image, (2) SDE with manual and automatic modes, (3) loading a target video, (4) visualizing PAAP results, and (5) rendering panning data in a digital audio workstation (DAW) via the open sound control (OSC) protocol. Some parts of PAAP still require improvement, including the spatial information prediction algorithm and resource optimization. These issues may be resolved through an enhanced algorithm and a more efficient processing mechanism. Despite this, the system shows strong potential to advance automatic audio panning and streamline existing workflows.
Zitieren
APA
Lee, K., & Kim, S. (2025). Developing a user-centric interface for performer-aware automatic panning system. The Journal of the Acoustical Society of America, 158(4_Supplement), A433-A433. https://doi.org/10.1121/10.0041412
Vancouver
Lee K, Kim S. Developing a user-centric interface for performer-aware automatic panning system. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A433-A433. doi:10.1121/10.0041412
BibTeX
@article{Lee2025,
author = {Lee, Kangeun and Kim, Sungyoung},
title = {Developing a user-centric interface for performer-aware automatic panning system},
journal = {The Journal of the Acoustical Society of America},
year = {2025},
volume = {158},
number = {4_Supplement},
pages = {A433--A433},
doi = {10.1121/10.0041412}
}
EUVIMED