Mixed Reality-Based Multi-Scenario Visualization and Control in Automated Terminals: A Middleware and Digital Twin Driven Approach
Buildings · 27.10.2025 · 15 (21) · 3879
DOI: 10.3390/buildings15213879 ↗Kurz gefasst
Fachartikel in der Zeitschrift Buildings, online erschienen am 27.10.2025. Verfasst von Yubo Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key R&D Program of China, the National Natural Science Foundation of China, the Youth Foundation Project of Humanities and Social Sciences Research of the Ministry of Education.
Abstract (Originalsprache)
This study presents a Digital Twin–Mixed Reality (DT–MR) framework for the immersive and interactive supervision of automated container terminals (ACTs), addressing the fragmented data and limited situational awareness of conventional 2D monitoring systems. The framework employs a middleware-centric architecture that integrates heterogeneous subsystems—covering terminal operation, equipment control, and information management—through standardized industrial communication protocols. It ensures synchronized timestamps and delivers semantically aligned, low-latency data streams to a multi-scale Digital Twin developed in Unity. The twin applies level-of-detail modeling, spatial anchoring, and coordinate alignment (from Industry Foundation Classes (IFCs) to east–north–up (ENU) coordinates and Unity space) for accurate registration with physical assets, while a Microsoft HoloLens 2 device provides an intuitive Mixed Reality interface that combines gaze, gesture, and voice commands with built-in safety interlocks for secure human–machine interaction. Quantitative performance benchmarks—latency ≤100 ms, status refresh ≤1 s, and throughput ≥10,000 events/s—were met through targeted engineering and validated using representative scenarios of quay crane alignment and automated guided vehicle (AGV) rerouting, demonstrating improved anomaly detection, reduced decision latency, and enhanced operational resilience. The proposed DT–MR pipeline establishes a reproducible and extensible foundation for real-time, human-in-the-loop supervision across ports, airports, and other large-scale smart infrastructures.
Förderung
- National Key R&D Program of China
- the National Natural Science Foundation of China
- the Youth Foundation Project of Humanities and Social Sciences Research of the Ministry of Education
Zitieren
APA
Wang, Y., Zhang, E., Yang, A., Du, K., & Gao, J. (2025). Mixed Reality-Based Multi-Scenario Visualization and Control in Automated Terminals: A Middleware and Digital Twin Driven Approach. Buildings, 15(21), 3879. https://doi.org/10.3390/buildings15213879
Vancouver
Wang Y, Zhang E, Yang A, Du K, Gao J. Mixed Reality-Based Multi-Scenario Visualization and Control in Automated Terminals: A Middleware and Digital Twin Driven Approach. Buildings. 2025;15(21):3879. doi:10.3390/buildings15213879
BibTeX
@article{Wang2025,
author = {Wang, Yubo and Zhang, Enyu and Yang, Ang and Du, Keshuang and Gao, Jing},
title = {Mixed Reality-Based Multi-Scenario Visualization and Control in Automated Terminals: A Middleware and Digital Twin Driven Approach},
journal = {Buildings},
year = {2025},
volume = {15},
number = {21},
pages = {3879},
doi = {10.3390/buildings15213879}
}
EUVIMED