EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

FaceTouch: Detecting hand-to-face touch with supervised contrastive learning to assist in tracing infectious diseases

Mohamed R Ibrahim iD, Terry Lyons

PLOS ONE · 13.06.2024 · 19 (6) · e0288670

DOI: 10.1371/journal.pone.0288670 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 13.06.2024. Verfasst von Mohamed R Ibrahim und 1 weiteren Autor:innen. Beteiligte Einrichtung: Centre for Data Analysis and Policy, University of Leeds, Leeds, United Kingdom. Hauptthemen laut MEDLINE: COVID-19. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: PROTECT COVID-19 National Core Study on transmission and environment, managed by the Health and Safety Executive on behalf of HM Government, Alan Turing Institute, Engineering and Physical Sciences Research Council.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Through our respiratory system, many viruses and diseases frequently spread and pass from one person to another. Covid-19 served as an example of how crucial it is to track down and cut back on contacts to stop its spread. There is a clear gap in finding automatic methods that can detect hand-to-face contact in complex urban scenes or indoors. In this paper, we introduce a computer vision framework, called FaceTouch, based on deep learning. It comprises deep sub-models to detect humans and analyse their actions. FaceTouch seeks to detect hand-to-face touches in the wild, such as through video chats, bus footage, or CCTV feeds. Despite partial occlusion of faces, the introduced system learns to detect face touches from the RGB representation of a given scene by utilising the representation of the body gestures such as arm movement. This has been demonstrated to be useful in complex urban scenarios beyond simply identifying hand movement and its closeness to faces. Relying on Supervised Contrastive Learning, the introduced model is trained on our collected dataset, given the absence of other benchmark datasets. The framework shows a strong validation in unseen datasets which opens the door for potential deployment.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

COVID-19HumansSARS-CoV-2TouchDeep LearningHandContact TracingSupervised Machine LearningGesturesFace

Autor:innen und Institutionen

  • Centre for Data Analysis and Policy, University of Leeds, Leeds, United Kingdom.
  • Leeds Institute for Data Analytics (LIDA), Leeds, United Kingdom.
  • The Alan Turing Institute, London, United Kingdom.
  • Mathematical Institute, University of Oxford, Oxford, United Kingdom.

ORCID-Profile: Mohamed R Ibrahim

Förderung

  • PROTECT COVID-19 National Core Study on transmission and environment, managed by the Health and Safety Executive on behalf of HM Government
  • Alan Turing Institute
  • Engineering and Physical Sciences Research Council

Zitieren

APA

Ibrahim, M. R., & Lyons, T. (2024). FaceTouch: Detecting hand-to-face touch with supervised contrastive learning to assist in tracing infectious diseases. PLOS ONE, 19(6), e0288670. https://doi.org/10.1371/journal.pone.0288670

Vancouver

Ibrahim MR, Lyons T. FaceTouch: Detecting hand-to-face touch with supervised contrastive learning to assist in tracing infectious diseases. PLOS ONE. 2024;19(6):e0288670. doi:10.1371/journal.pone.0288670

BibTeX
@article{Ibrahim2024,
  author = {Ibrahim, Mohamed R and Lyons, Terry},
  title = {FaceTouch: Detecting hand-to-face touch with supervised contrastive learning to assist in tracing infectious diseases},
  journal = {PLOS ONE},
  year = {2024},
  volume = {19},
  number = {6},
  pages = {e0288670},
  doi = {10.1371/journal.pone.0288670}
}
Kostenlos starten →