EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep Neural Network-Based Visual Feedback System for Nasopharyngeal Swab Sampling

Suhun Jung, Yonghwan Moon iD, Jeongryul Kim, Keri Kim

Sensors · 2023

DOI: 10.3390/s23208443 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Suhun Jung und 3 weiteren Autor:innen. Beteiligte Einrichtung: Artificial Intelligence and Robot Institute, Korea Institute of Science and Technology, 5, Hwarang-ro 14-gil, Seongbuk-gu, Seoul 02792, Republic of K…. Hauptthemen laut MEDLINE: Feedback, Sensory, Surgery, Computer-Assisted. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation of Korea, Ministry of Science and ICT (MSIT), National Research Council of Science and Technology (NST) grant by the Ministry of Science and ICT (MSIT).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

During the 2019 coronavirus disease pandemic, robotic-based systems for swab sampling were developed to reduce burdens on healthcare workers and their risk of infection. Teleoperated sampling systems are especially appreciated as they fundamentally prevent contact with suspected COVID-19 patients. However, the limited field of view of the installed cameras prevents the operator from recognizing the position and deformation of the swab inserted into the nasal cavity, which highly decreases the operating performance. To overcome this limitation, this study proposes a visual feedback system that monitors and reconstructs the shape of an NP swab using augmented reality (AR). The sampling device contained three load cells and measured the interaction force applied to the swab, while the shape information was captured using a motion-tracking program. These datasets were used to train a one-dimensional convolution neural network (1DCNN) model, which estimated the coordinates of three feature points of the swab in 2D X–Y plane. Based on these points, the virtual shape of the swab, reflecting the curvature of the actual one, was reconstructed and overlaid on the visual display. The accuracy of the 1DCNN model was evaluated on a 2D plane under ten different bending conditions. The results demonstrate that the x-values of the predicted points show errors of under 0.590 mm from P0, while those of P1 and P2 show a biased error of about −1.5 mm with constant standard deviations. For the y-values, the error of all feature points under positive bending is uniformly estimated with under 1 mm of difference, when the error under negative bending increases depending on the amount of deformation. Finally, experiments using a collaborative robot validate its ability to visualize the actual swab’s position and deformation on the camera image of 2D and 3D phantoms.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Feedback, SensorySurgery, Computer-AssistedHumansSpecimen HandlingNeural Networks, ComputerNasopharynx

Stichwörter der Autor:innen

1-dimensional convolution neural networkaugmented realityfiducial markerload cellnasopharyngeal swab testing

Autor:innen und Institutionen

  • Artificial Intelligence and Robot Institute, Korea Institute of Science and Technology, 5, Hwarang-ro 14-gil, Seongbuk-gu, Seoul 02792, Republic of Korea.
  • School of Mechanical Engineering, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul 02841, Republic of Korea.
  • Augmented Safety System with Intelligence Sensing and Tracking, Korea Institute of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk-gu, Seoul 02792, Republic of Korea.
  • Division of Bio-Medical Science and Technology, University of Science and Technology, 217 Gajeong-ro, Yuseong-gu, Daejeon 34113, Republic of Korea.

ORCID-Profile: Yonghwan Moon

Förderung

  • National Research Foundation of Korea
  • Ministry of Science and ICT (MSIT)
  • National Research Council of Science and Technology (NST) grant by the Ministry of Science and ICT (MSIT)
  • Basic Science Research Program through the National Research Foundation of Korea (NRF), funded by the Ministry of Education

Zitieren

APA

Jung, S., Moon, Y., Kim, J., & Kim, K. (2023). Deep Neural Network-Based Visual Feedback System for Nasopharyngeal Swab Sampling. Sensors. https://doi.org/10.3390/s23208443

Vancouver

Jung S, Moon Y, Kim J, Kim K. Deep Neural Network-Based Visual Feedback System for Nasopharyngeal Swab Sampling. Sensors. 2023. doi:10.3390/s23208443

BibTeX
@article{Jung2023,
  author = {Jung, Suhun and Moon, Yonghwan and Kim, Jeongryul and Kim, Keri},
  title = {Deep Neural Network-Based Visual Feedback System for Nasopharyngeal Swab Sampling},
  journal = {Sensors},
  year = {2023},
  doi = {10.3390/s23208443}
}
Kostenlos starten →