Using Mixed Reality for Control and Monitoring of Robot Model Based on Robot Operating System 2
Electronics · 06.09.2024 · 13 (17) · 3554
DOI: 10.3390/electronics13173554 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 06.09.2024. Verfasst von Dominik Janecký und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Scientific Grant Agency of the Ministry of Education, Research, Development and Youth of the Slovak Republic, Slovak Agency for Research and Development.
Abstract (Originalsprache)
This article presents the design and implementation of an innovative human–machine interface (HMI) in mixed reality for a robot model operating within Robot Operating System 2 (ROS 2). The interface is specifically developed for compatibility with Microsoft HoloLens 2 hardware and leverages the Unity game engine alongside the Mixed Reality Toolkit (MRTK) to create an immersive mixed reality application. The project uses the Turtlebot 3 Burger model robot, simulated within the Gazebo virtual environment, as a representative mechatronic system for demonstration purposes. Communication between the mixed reality application and ROS 2 is facilitated through a publish–subscribe mechanism, utilizing ROS TCP Connector for message serialization between nodes. This interface not only enhances the user experience by allowing for the real-time monitoring and control of the robotic system but also aligns with the principles of Industry 5.0, emphasizing human-centric and inclusive technological advancements. The practical outcomes of this research include a fully functional mixed reality application that integrates seamlessly with ROS 2, showcasing the potential of mixed reality technologies in advancing the field of industrial automation and human–machine interaction.
Förderung
- Scientific Grant Agency of the Ministry of Education, Research, Development and Youth of the Slovak Republic
- Slovak Agency for Research and Development
Zitieren
APA
Janecký, D., Kučera, E., Haffner, O., Výchlopeňová, E., & Rosinová, D. (2024). Using Mixed Reality for Control and Monitoring of Robot Model Based on Robot Operating System 2. Electronics, 13(17), 3554. https://doi.org/10.3390/electronics13173554
Vancouver
Janecký D, Kučera E, Haffner O, Výchlopeňová E, Rosinová D. Using Mixed Reality for Control and Monitoring of Robot Model Based on Robot Operating System 2. Electronics. 2024;13(17):3554. doi:10.3390/electronics13173554
BibTeX
@article{Janeck2024,
author = {Janecký, Dominik and Kučera, Erik and Haffner, Oto and Výchlopeňová, Erika and Rosinová, Danica},
title = {Using Mixed Reality for Control and Monitoring of Robot Model Based on Robot Operating System 2},
journal = {Electronics},
year = {2024},
volume = {13},
number = {17},
pages = {3554},
doi = {10.3390/electronics13173554}
}
EUVIMED