EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Computer Vision-Driven Movement Annotations to Advance fNIRS Pre-Processing Algorithms

Andrea Bizzego iD, Alessandro Carollo iD, Burak Senay, Seraphina Fong iD, Cesare Furlanello iD, Gianluca Esposito iD

Sensors · 2024

DOI: 10.3390/s24216821 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2024. Verfasst von Andrea Bizzego und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto, Italy. Hauptthemen laut MEDLINE: Spectroscopy, Near-Infrared, Algorithms, Head Movements. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union - FSE-REACT-EU, PON Research and Innovation, European Union—FSE-REACT-EU, PON Research and Innovation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Functional near-infrared spectroscopy (fNIRS) is beneficial for studying brain activity in naturalistic settings due to its tolerance for movement. However, residual motion artifacts still compromise fNIRS data quality and might lead to spurious results. Although some motion artifact correction algorithms have been proposed in the literature, their development and accurate evaluation have been challenged by the lack of ground truth information. This is because ground truth information is time- and labor-intensive to manually annotate. This work investigates the feasibility and reliability of a deep learning computer vision (CV) approach for automated detection and annotation of head movements from video recordings. Fifteen participants performed controlled head movements across three main rotational axes (head up/down, head left/right, bend left/right) at two speeds (fast and slow), and in different ways (half, complete, repeated movement). Sessions were video recorded and head movement information was obtained using a CV approach. A 1-dimensional UNet model (1D-UNet) that detects head movements from head orientation signals extracted via a pre-trained model (SynergyNet) was implemented. Movements were manually annotated as a ground truth for model evaluation. The model’s performance was evaluated using the Jaccard index. The model showed comparable performance between the training and test sets (J train = 0.954; J test = 0.865). Moreover, it demonstrated good and consistent performance at annotating movement across movement axes and speeds. However, performance varied by movement type, with the best results being obtained for repeated (J test = 0.941), followed by complete (J test = 0.872), and then half movements (J test = 0.826). This study suggests that the proposed CV approach provides accurate ground truth movement information. Future research can rely on this CV approach to evaluate and improve fNIRS motion artifact correction algorithms.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Spectroscopy, Near-InfraredAlgorithmsHead MovementsHumansMaleAdultFemaleMovementYoung AdultBrainVideo RecordingArtifactsDeep Learning

Stichwörter der Autor:innen

computer visiondeep learningfNIRSfunctional near-infrared spectroscopymotion artifact algorithmsmotion detectionneuroimaging

Autor:innen und Institutionen

  • Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto, Italy.
  • HK3 Lab, 38068 Rovereto, Italy.

ORCID-Profile: Andrea Bizzego, Alessandro Carollo, Seraphina Fong, Cesare Furlanello, Gianluca Esposito

Förderung

  • European Union - FSE-REACT-EU, PON Research and Innovation
  • European Union—FSE-REACT-EU, PON Research and Innovation

Zitieren

APA

Bizzego, A., Carollo, A., Senay, B., Fong, S., Furlanello, C., & Esposito, G. (2024). Computer Vision-Driven Movement Annotations to Advance fNIRS Pre-Processing Algorithms. Sensors. https://doi.org/10.3390/s24216821

Vancouver

Bizzego A, Carollo A, Senay B, Fong S, Furlanello C, Esposito G. Computer Vision-Driven Movement Annotations to Advance fNIRS Pre-Processing Algorithms. Sensors. 2024. doi:10.3390/s24216821

BibTeX
@article{Bizzego2024,
  author = {Bizzego, Andrea and Carollo, Alessandro and Senay, Burak and Fong, Seraphina and Furlanello, Cesare and Esposito, Gianluca},
  title = {Computer Vision-Driven Movement Annotations to Advance fNIRS Pre-Processing Algorithms},
  journal = {Sensors},
  year = {2024},
  doi = {10.3390/s24216821}
}
Kostenlos starten →