EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Learning end-to-end respiratory rate prediction of dairy cows from red, green, and blue videos

M Wang, S Li, R Peng, S E Räisänen, A M Serviento, X Sun, K Wang, F Yu, M Niu

Journal of Dairy Science · 2024-11 · 107 (11) · 9862-9874

DOI: 10.3168/jds.2023-24601 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Dairy Science, 2024-11. Verfasst von M Wang und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Environmental Systems Science, Institute of Agricultural Sciences, ETH Zürich, 8092 Zürich, Switzerland. Hauptthemen laut MEDLINE: Respiratory Rate. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Respiratory rate (RR) is an important indicator of the health and welfare status of dairy cows. In recent years, progress has been made in monitoring the RR of dairy cows using video data and learning methods. However, existing approaches often involve multiple processing modules, such as region of interest (ROI) detection and tracking, which can introduce errors that propagate through successive steps. The objective of this study was to develop an end-to-end computer vision method to predict RR of dairy cows continuously and automatically. The method leverages the capabilities of a state-of-the-art Transformer model, VideoMAE, which divides video frames into patches as input tokens, enabling the automated selection and featurization of relevant regions, such as a cow's abdomen, for predicting RR. The original encoder of VideoMAE was retained, and a classification head was added on top of it. Further, the weights of the first 11 layers of the pre-trained model were kept, whereas the weights of the final layer and classifier were fine-tuned using video data collected in a tiestall barn from 6 dairy cows. Respiratory rates measured using a respiratory belt for individual cows were serving as the ground truth (GT). The evaluation of the developed model was conducted using multiple metrics, including mean absolute error (MAE) of 2.58 breaths per minute (bpm), root mean squared error (RMSE) of 3.52 bpm, root mean squared prediction error (RMSPE; as a proportion of observed mean) of 15.03%, and Pearson r of 0.86. Compared with a conventional method involving multiple processing modules, the end-to-end approach performed better in terms of MAE, RMSE, and RMSPE. These results suggest the potential to implement the developed computer vision method for an end-to-end solution, for monitoring RR of dairy cows automatically in a tiestall setting. Future research on integrating this method with other behavioral detection and animal identification algorithms for animal monitoring in a freestall dairy barn can be beneficial for a broader application.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Respiratory RateAnimalsCattleFemaleVideo Recording

Stichwörter der Autor:innen

animal welfarecomputer visionphysiological parametersprecision livestock farmingtransformer

Autor:innen und Institutionen

  • Department of Environmental Systems Science, Institute of Agricultural Sciences, ETH Zürich, 8092 Zürich, Switzerland.
  • Department of Information Technology and Electrical Engineering, ETH Zürich, 8092 Zürich, Switzerland.
  • Department of Environmental Systems Science, Institute of Agricultural Sciences, ETH Zürich, 8092 Zürich, Switzerland. Electronic address: mutian.niu@usys.ethz.ch.

Zitieren

APA

Wang, M., Li, S., Peng, R., Räisänen, S. E., Serviento, A. M., Sun, X., Wang, K., Yu, F., & Niu, M. (2024). Learning end-to-end respiratory rate prediction of dairy cows from red, green, and blue videos. Journal of Dairy Science, 107(11), 9862-9874. https://doi.org/10.3168/jds.2023-24601

Vancouver

Wang M, Li S, Peng R, Räisänen SE, Serviento AM, Sun X, et al. Learning end-to-end respiratory rate prediction of dairy cows from red, green, and blue videos. Journal of Dairy Science. 2024;107(11):9862-9874. doi:10.3168/jds.2023-24601

BibTeX
@article{Wang2024,
  author = {Wang, M and Li, S and Peng, R and Räisänen, S E and Serviento, A M and Sun, X and Wang, K and Yu, F and Niu, M},
  title = {Learning end-to-end respiratory rate prediction of dairy cows from red, green, and blue videos},
  journal = {Journal of Dairy Science},
  year = {2024},
  volume = {107},
  number = {11},
  pages = {9862--9874},
  doi = {10.3168/jds.2023-24601}
}
Kostenlos starten →