EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

A Vision-Based Deep Learning Framework for Monitoring and Recognition of Chemical Laboratory Operations

Chuntao Guo, Jing Lin, Shunxing Bao iD, Xin Liu, Yaru Wang, Yunlin Chen iD

Sensors · 2026

DOI: 10.3390/s26041106 ↗

At a glance

Journal article in Sensors, 2026. Written by Chuntao Guo and 5 co-authors. Institution: School of Physical Science and Engineering, Beijing Jiaotong University, Beijing 100044, China. Major MEDLINE topics: Deep Learning, Laboratories. Cited 4 times so far (Crossref); 35 references. The full text is freely available (open access, CC BY 4.0). Funded by: Jiangsu Provincial Administration for Market Regulation Science and Tech Plan Project, Jiangsu Provincial Administration for Market Regulation Science and Technology Plan Project.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Standardized operating procedures are essential for ensuring safety and reproducibility in chemical laboratory experiments. However, real-time monitoring of manual laboratory operations, such as pipetting, remains challenging due to complex human–tool interactions, temporal dependencies between procedural steps, and operator variability. In this study, we propose a vision-based deep learning framework that leverages spatiotemporal features for automated monitoring of pipetting operations using non-contact visual sensing. Briefly, human poses and pipette interactions are extracted from video recordings using a YOLO-based perception model, while temporal execution patterns are captured through bidirectional long short-term memory networks. Experimental results demonstrate that the proposed approach can reliably distinguish between standard and non-standard pipetting behaviors across multiple predefined error categories and shows improved robustness compared with static or frame-level analysis. Overall, this work demonstrates the feasibility of vision-based AI systems for objective and scalable monitoring of laboratory pipetting operations, with potential applicability to other manual laboratory procedures.

Subjects

MeSH terms (MEDLINE)

Deep LearningLaboratoriesHumansDetection AlgorithmsLong Short Term MemoryAlgorithms

Author keywords

laboratory quality assurancepipetting behaviorpose estimationspatiotemporal modelingvision-based sensing

Authors and institutions

  • School of Physical Science and Engineering, Beijing Jiaotong University, Beijing 100044, China.
  • Beijing Purkinje General Instrument Co., Ltd., Beijing 100081, China.
  • Nanjing Institute of Measurement and Testing Technology, Nanjing 210049, China.
  • Institute of Analysis and Testing, Beijing Academy of Science and Technology (Beijing Center for Physical and Chemical Analysis), Beijing 100089, China.
  • School of Bioengineering, Beijing Polytechnic University, Beijing 100021, China.

ORCID profiles: Shunxing Bao, Yunlin Chen

Funding

  • Jiangsu Provincial Administration for Market Regulation Science and Tech Plan Project
  • Jiangsu Provincial Administration for Market Regulation Science and Technology Plan Project

Cite

APA

Guo, C., Lin, J., Bao, S., Liu, X., Wang, Y., & Chen, Y. (2026). A Vision-Based Deep Learning Framework for Monitoring and Recognition of Chemical Laboratory Operations. Sensors. https://doi.org/10.3390/s26041106

Vancouver

Guo C, Lin J, Bao S, Liu X, Wang Y, Chen Y. A Vision-Based Deep Learning Framework for Monitoring and Recognition of Chemical Laboratory Operations. Sensors. 2026. doi:10.3390/s26041106

BibTeX
@article{Guo2026,
  author = {Guo, Chuntao and Lin, Jing and Bao, Shunxing and Liu, Xin and Wang, Yaru and Chen, Yunlin},
  title = {A Vision-Based Deep Learning Framework for Monitoring and Recognition of Chemical Laboratory Operations},
  journal = {Sensors},
  year = {2026},
  doi = {10.3390/s26041106}
}
Start for free →