EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Digital Twin-Based Virtual Reality Framework for Interaction and AI-Assisted Control of a Parallel Surgical Robot

Florin Covaciu iD, Nadim Al Hajjar, Anca-Elena Iordan iD, Radu Corina, Bogdan Gherman iD, Andrei Cailean, Andra Ciocan iD, Alexandru Pusca iD, Paul Tucan iD, Doina Pisla iD

Sensors · 11.07.2026 · 26 (14) · 4410

DOI: 10.3390/s26144410 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 11.07.2026. Verfasst von Florin Covaciu und 9 weiteren Autor:innen. Beteiligte Einrichtung: Research Center for Industrial Robots Simulation and Testing-CESTER, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania. Hauptthemen laut MEDLINE: Virtual Reality, Robotic Surgical Procedures, Artificial Intelligence, Robotics. Die Arbeit nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union, “Romanian Hub for Artificial Intelligence—HRIA”.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid advancement of robot-assisted minimally invasive surgery (RAMIS) has created an increasing demand for integrated solutions that combine advanced robotic actuation, sensing, and intelligent control within unified training and operational frameworks. This paper presents a Digital Twin–based virtual reality (VR) interaction and control system developed for an innovative parallel surgical robot, designed to support both surgical training and real-time robot interaction. The proposed framework extends a conventional VR simulator into a bidirectional Digital Twin architecture, enabling real-time synchronization between a virtual environment and the physical robotic system. The system integrates the ATHENA parallel robot, characterized by a 4-degree-of-freedom architecture with a Remote Center of Motion (RCM) constraint, together with a flexible laparoscopic instrument providing enhanced dexterity. Interaction is achieved using VR controllers, allowing intuitive manipulation of the robotic system within an immersive environment. To enhance operational performance, an artificial intelligence module based on neural networks is integrated as an assistive component, providing real-time trajectory refinement and motion guidance. The trained model is deployed using an ONNX-compatible runtime, ensuring efficient inference and seamless integration within the control architecture. The proposed system is validated through experimental evaluation of user interaction and task execution performance, as well as through external motion assessment using an OptiTrack optical tracking system. The results demonstrate improvements in motion stability, execution efficiency, and user interaction quality, while maintaining a high level of control intuitiveness. The findings highlight the potential of Digital Twin–based VR systems as a unifying platform for surgical training, interaction, and intelligent assistance in next-generation medical robotic systems.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Virtual RealityRobotic Surgical ProceduresArtificial IntelligenceRoboticsHumansUser-Computer InterfaceMinimally Invasive Surgical ProceduresNeural Networks, Computer

Stichwörter der Autor:innen

VR headsetartificial intelligenceparallel robotsimulator trainingsurgical robotuser interfacevirtual reality

Autor:innen und Institutionen

  • Research Center for Industrial Robots Simulation and Testing-CESTER, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania.
  • European University of Technology, European Union.
  • Department of Surgery, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400347 Cluj-Napoca, Romania.
  • Department of Computer Science, Technical University of Cluj-Napoca, 400027 Cluj-Napoca, Romania.
  • Department of Internal Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400347 Cluj-Napoca, Romania.
  • Technical Sciences Academy of Romania, B-dul Dacia, 26, 030167 Bucharest, Romania.

ORCID-Profile: Florin Covaciu, Anca-Elena Iordan, Bogdan Gherman, Andra Ciocan, Alexandru Pusca, Paul Tucan, Doina Pisla

Förderung

  • European Union
  • “Romanian Hub for Artificial Intelligence—HRIA”

Zitieren

APA

Covaciu, F., Hajjar, N. A., Iordan, A. E., Corina, R., Gherman, B., Cailean, A., Ciocan, A., Pusca, A., Tucan, P., & Pisla, D. (2026). Digital Twin-Based Virtual Reality Framework for Interaction and AI-Assisted Control of a Parallel Surgical Robot. Sensors, 26(14), 4410. https://doi.org/10.3390/s26144410

Vancouver

Covaciu F, Hajjar NA, Iordan AE, Corina R, Gherman B, Cailean A, et al. Digital Twin-Based Virtual Reality Framework for Interaction and AI-Assisted Control of a Parallel Surgical Robot. Sensors. 2026;26(14):4410. doi:10.3390/s26144410

BibTeX
@article{Covaciu2026,
  author = {Covaciu, Florin and Hajjar, Nadim Al and Iordan, Anca-Elena and Corina, Radu and Gherman, Bogdan and Cailean, Andrei and Ciocan, Andra and Pusca, Alexandru and Tucan, Paul and Pisla, Doina},
  title = {Digital Twin-Based Virtual Reality Framework for Interaction and AI-Assisted Control of a Parallel Surgical Robot},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {14},
  pages = {4410},
  doi = {10.3390/s26144410}
}
Kostenlos starten →