EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Impact of cross-validation designs on cattle behavior prediction using machine learning and deep learning models with tri-axial accelerometer data

Jin Wang, Ziwen Yu, Ricardo C. Chebel, Haipeng Yu

Smart Agricultural Technology · 2025-12 · 12 · 101483

DOI: 10.1016/j.atech.2025.101483 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Smart Agricultural Technology, 2025-12. Verfasst von Jin Wang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Florida.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

1 Abstract Assessing cattle behaviors provides insights into animal health, welfare, and productivity to support on-farm management decisions. Wearable accelerometers offer an alternative approach to traditional human evaluation, providing a more objective and efficient method for predicting cattle behavior. Random cross-validation (CV) is commonly used to evaluate behavior prediction by splitting data into training and testing sets, but it can yield inflated results when records from the same animal are included in both sets. Block CV splits data by block effects, offering a more realistic evaluation but remains underexplored for predicting multi-class imbalanced cattle behavior. Additionally, deep learning (DL) models have not been fully explored for behavior prediction compared to machine learning (ML) models. The objectives of this study were to examine the impact of CV designs on multi-class imbalanced cattle behavior prediction and to compare the performance of ML and DL models. Three ML and two DL models were used to predict the four behaviors of six beef cows from a public tri-axial accelerometer dataset, with model performance evaluated using both hold-out and leave-cow-out CV designs representing random and block CV, respectively. In hold-out CV, ML models achieved accuracies of 0.94 to 0.96 and F1 scores of 0.93 to 0.95, while DL models achieved accuracies of 0.9 to 0.92 and F1 scores of 0.89 to 0.91. In the leave-cow-out CV, ML models obtained accuracies of 0.72 to 0.82 and F1 scores of 0.64 to 0.82, whereas DL models obtained accuracies of 0.76 to 0.82 and F1 scores of 0.64 to 0.76. Generally, ML models outperformed DL models in the hold-out CV, but the multi-layer perceptron DL model demonstrated comparable or superior performance in the leave-cow-out CV. All models performed better with hold-out CV than leave-cow-out CV. Our results suggest that CV designs can affect behavior prediction performance. While a random CV produces seemingly good predictions, these results can be artificially inflated by the data partition. A block CV that strategically partitions data could be a more appropriate design.

Förderung

  • University of Florida

Zitieren

APA

Wang, J., Yu, Z., Chebel, R. C., & Yu, H. (2025). Impact of cross-validation designs on cattle behavior prediction using machine learning and deep learning models with tri-axial accelerometer data. Smart Agricultural Technology, 12, 101483. https://doi.org/10.1016/j.atech.2025.101483

Vancouver

Wang J, Yu Z, Chebel RC, Yu H. Impact of cross-validation designs on cattle behavior prediction using machine learning and deep learning models with tri-axial accelerometer data. Smart Agricultural Technology. 2025;12:101483. doi:10.1016/j.atech.2025.101483

BibTeX
@article{Wang2025,
  author = {Wang, Jin and Yu, Ziwen and Chebel, Ricardo C. and Yu, Haipeng},
  title = {Impact of cross-validation designs on cattle behavior prediction using machine learning and deep learning models with tri-axial accelerometer data},
  journal = {Smart Agricultural Technology},
  year = {2025},
  volume = {12},
  pages = {101483},
  doi = {10.1016/j.atech.2025.101483}
}
Kostenlos starten →