Deep Neural Network-Based Visual Feedback System for Nasopharyngeal Swab Sampling
Sensors · 2023
DOI: 10.3390/s23208443 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Suhun Jung und 3 weiteren Autor:innen. Beteiligte Einrichtung: Artificial Intelligence and Robot Institute, Korea Institute of Science and Technology, 5, Hwarang-ro 14-gil, Seongbuk-gu, Seoul 02792, Republic of K…. Hauptthemen laut MEDLINE: Feedback, Sensory, Surgery, Computer-Assisted. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation of Korea, Ministry of Science and ICT (MSIT), National Research Council of Science and Technology (NST) grant by the Ministry of Science and ICT (MSIT).
Abstract (Originalsprache)
During the 2019 coronavirus disease pandemic, robotic-based systems for swab sampling were developed to reduce burdens on healthcare workers and their risk of infection. Teleoperated sampling systems are especially appreciated as they fundamentally prevent contact with suspected COVID-19 patients. However, the limited field of view of the installed cameras prevents the operator from recognizing the position and deformation of the swab inserted into the nasal cavity, which highly decreases the operating performance. To overcome this limitation, this study proposes a visual feedback system that monitors and reconstructs the shape of an NP swab using augmented reality (AR). The sampling device contained three load cells and measured the interaction force applied to the swab, while the shape information was captured using a motion-tracking program. These datasets were used to train a one-dimensional convolution neural network (1DCNN) model, which estimated the coordinates of three feature points of the swab in 2D X–Y plane. Based on these points, the virtual shape of the swab, reflecting the curvature of the actual one, was reconstructed and overlaid on the visual display. The accuracy of the 1DCNN model was evaluated on a 2D plane under ten different bending conditions. The results demonstrate that the x-values of the predicted points show errors of under 0.590 mm from P0, while those of P1 and P2 show a biased error of about −1.5 mm with constant standard deviations. For the y-values, the error of all feature points under positive bending is uniformly estimated with under 1 mm of difference, when the error under negative bending increases depending on the amount of deformation. Finally, experiments using a collaborative robot validate its ability to visualize the actual swab’s position and deformation on the camera image of 2D and 3D phantoms.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Artificial Intelligence and Robot Institute, Korea Institute of Science and Technology, 5, Hwarang-ro 14-gil, Seongbuk-gu, Seoul 02792, Republic of Korea.
- School of Mechanical Engineering, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul 02841, Republic of Korea.
- Augmented Safety System with Intelligence Sensing and Tracking, Korea Institute of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk-gu, Seoul 02792, Republic of Korea.
- Division of Bio-Medical Science and Technology, University of Science and Technology, 217 Gajeong-ro, Yuseong-gu, Daejeon 34113, Republic of Korea.
ORCID-Profile: Yonghwan Moon
Förderung
- National Research Foundation of Korea
- Ministry of Science and ICT (MSIT)
- National Research Council of Science and Technology (NST) grant by the Ministry of Science and ICT (MSIT)
- Basic Science Research Program through the National Research Foundation of Korea (NRF), funded by the Ministry of Education
Zitieren
APA
Jung, S., Moon, Y., Kim, J., & Kim, K. (2023). Deep Neural Network-Based Visual Feedback System for Nasopharyngeal Swab Sampling. Sensors. https://doi.org/10.3390/s23208443
Vancouver
Jung S, Moon Y, Kim J, Kim K. Deep Neural Network-Based Visual Feedback System for Nasopharyngeal Swab Sampling. Sensors. 2023. doi:10.3390/s23208443
BibTeX
@article{Jung2023,
author = {Jung, Suhun and Moon, Yonghwan and Kim, Jeongryul and Kim, Keri},
title = {Deep Neural Network-Based Visual Feedback System for Nasopharyngeal Swab Sampling},
journal = {Sensors},
year = {2023},
doi = {10.3390/s23208443}
}
EUVIMED