EUVIMEDScopri EUVIMED
Open access · CC BY 4.0

Multimodal immersive digital twin platform for cyber–physical robot fleets in nuclear environments

Paul Dominick E. Baniqued, Paul Bremner, Melissa Sandison, Samuel Harper, Subham Agrawal, Joseph Bolarinwa, Jamie Blanche, Zhengyi Jiang, Thomas Johnson, Daniel Mitchell, Erwin Jose Lopez Pulgarin, Andrew West and 7 more

Journal of Field Robotics · 2024-08 · 41 (5) · 1521-1540

DOI: 10.1002/rob.22329 ↗

At a glance

Journal article in Journal of Field Robotics, published online on 2024-04-11. Written by Paul Dominick E. Baniqued and 18 co-authors. Cited 26 times so far (Crossref); 61 references. The full text is freely available (open access, CC BY 4.0). Funded by: UK Research and Innovation, Engineering and Physical Sciences Research Council.

AbstractDati bibliograficiCiteRelated studies

Abstract (original language)

The nuclear energy sector can benefit from mobile robots for remote inspection and handling, reducing human exposure to radiation. Advances in cyber–physical systems have improved robotic platforms in this sector through digital twin (DT) technology. DTs enhance situational awareness for robot operators, crucial for safety in the nuclear energy sector, and their value is anticipated to increase with the growing complexity of cyber–physical systems. The primary motivation of this work is to rapidly develop and evaluate a robot fleet interface that accounts for these benefits in the context of nuclear environments. Here, we introduce a multimodal immersive DT platform for cyber–physical robot fleets based on the ROS‐Unity 3D framework. The system design enables fleet monitoring and management by integrating building information models, mission parameters, robot sensor data, and multimodal user interaction through traditional and virtual reality interfaces. A modified heuristic evaluation approach, which accounts for the positive and negative aspects of the interface, was introduced to accelerate the iterative design process of our DT platform. Robot operators from leading nuclear research institutions (Sellafield Ltd. and the Japan Atomic Energy Agency) performed a simulated robot inspection mission while providing valuable insights into the design elements of the cyber–physical system. The three usability themes that emerged and inspired our design recommendations for future developers include increasing the interface's flexibility, considering each robot's individuality, and adapting the platform to expand sensor visualization capabilities.

Funding

  • UK Research and Innovation
  • Engineering and Physical Sciences Research Council

Cite

APA

Baniqued, P. D. E., Bremner, P., Sandison, M., Harper, S., Agrawal, S., Bolarinwa, J., Blanche, J., Jiang, Z., Johnson, T., Mitchell, D., Pulgarin, E. J. L., West, A., Willis, M., Yao, K., Flynn, D., Giuliani, M., Groves, K., Lennox, B., & Watson, S. (2024). Multimodal immersive digital twin platform for cyber–physical robot fleets in nuclear environments. Journal of Field Robotics, 41(5), 1521-1540. https://doi.org/10.1002/rob.22329

Vancouver

Baniqued PDE, Bremner P, Sandison M, Harper S, Agrawal S, Bolarinwa J, et al. Multimodal immersive digital twin platform for cyber–physical robot fleets in nuclear environments. Journal of Field Robotics. 2024;41(5):1521-1540. doi:10.1002/rob.22329

BibTeX
@article{Baniqued2024,
  author = {Baniqued, Paul Dominick E. and Bremner, Paul and Sandison, Melissa and Harper, Samuel and Agrawal, Subham and Bolarinwa, Joseph and Blanche, Jamie and Jiang, Zhengyi and Johnson, Thomas and Mitchell, Daniel and Pulgarin, Erwin Jose Lopez and West, Andrew and Willis, Melissa and Yao, Kanzhong and Flynn, David and Giuliani, Manuel and Groves, Keir and Lennox, Barry and Watson, Simon},
  title = {Multimodal immersive digital twin platform for cyber–physical robot fleets in nuclear environments},
  journal = {Journal of Field Robotics},
  year = {2024},
  volume = {41},
  number = {5},
  pages = {1521--1540},
  doi = {10.1002/rob.22329}
}
Start for free →