EUVIMEDOpdag EUVIMED
Open access

Interobserver agreement when using a four‐point mobility scoring system to score dairy cattle from video footage

Übereinstimmung zwischen Beobachter:innen bei der Anwendung eines vierstufigen Mobilitätsscores zur Beurteilung von Milchkühen anhand von Videomaterial

James P Wilson iD, Vivi Thorup iD, Nick J Bell

Veterinary Record · 2026-08-01 · 199 (3)

DOI: 10.1002/vetr.70801 ↗

Auf einen Blick

Bei 10 erfahrenen Beobachter:innen war die Übereinstimmung bei der Bewertung von 207 Kühen anhand von Videos insgesamt gering. Die Prävalenzschätzungen für Lahmheit variierten deutlich.

Fragestellung

Wie gut ist die Interobserver-Übereinstimmung bei einem vierstufigen Mobilitätsscore zwischen Beobachter:innen verschiedener Forschungsinstitute?

Methode

Beobachtungsstudie; 10 erfahrene Beobachter:innen bewerteten Videoausschnitte von 207 Kühen von neun Farmen. Übereinstimmung mit Gwet's AC1 und Fleiss’ κ.

Ergebnisse

Die Lahmheitsprävalenz (Mobilitätsscore ≥ 2) lag je nach Beobachter:in zwischen 36,2 % und 57,0 %. Paarweise lag Gwet's AC1 zwischen 35,6 % und 74,5 %; Gesamtübereinstimmung Fleiss’ κ = 0,28.

Einschränkungen

Kleiner Pool sehr erfahrener Beobachter:innen; Videos statt realer Scoring-Situation, daher eingeschränkte Übertragbarkeit.

Schlussfolgerung der Autor:innen

Standardisierungsverfahren für Lahmheitsbewertungen müssen nach Ansicht der Autor:innen dringend weiterentwickelt werden.

Kernaussagen

  • 207 Kühe in Videoclips von neun Farmen
  • Gwet's AC1: 35,6 % bis 74,5 %
  • Gesamtübereinstimmung gering: Fleiss’ κ = 0,28

Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.

At a glance

Journal article in Veterinary Record, published online on 2026-06-07. Written by James P Wilson and 2 co-authors. Institution: Department of Livestock and One Health, Institute of Infection, Veterinary and Ecological Sciences, University of Liverpool, Neston, UK. Major MEDLINE topics: Lameness, Animal, Video Recording, Cattle Diseases. 25 references. The full text is freely available in PubMed Central.

Auf einen BlickAbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Our observational study aimed to investigate the interobserver agreement between mobility observers of different research institutes.

Methods

Interobserver agreement when using a four‐point mobility score was assessed among 10 experienced observers. Video footage comprised of individual clips of 207 unique cows recorded while walking on nine different farms. Gwet's agreement coefficient (AC1) and Fleiss’ kappa were calculated and reported to measure the agreement between observers.

Results

Lameness (mobility score ≥ 2) prevalence estimates for the video footage sample varied from 36.2% to 57.0% between observers. The pairwise interobserver agreement (Gwet's AC1) ranged from 35.6% to 74.5%. The average observer agreement was 47.8%‐66.9%, with three observers below 60%. Measuring across all observers, overall agreement was poor (Fleiss’ κ = 0.28) despite their high level of experience.

Limitations

Our study used a small pool of observers with considerable experience in mobility scoring. We also used videos to ensure consistency in the cows presented to the observers, which may not be reflective of real‐world scoring conditions.

Conclusions

Standardisation procedures for lameness outcome assessments (among researchers and by logical extension, assessors working in the field) urgently require further development.

Subjects

MeSH terms (MEDLINE)

Lameness, AnimalVideo RecordingCattle DiseasesAnimalsCattleObserver VariationFemale

Authors and institutions

  • Department of Livestock and One Health, Institute of Infection, Veterinary and Ecological Sciences, University of Liverpool, Neston, UK.
  • Department of Animal and Veterinary Sciences, Aarhus University, Tjele, Denmark.
  • School of Veterinary Medicine, Perth, Western Australia, Australia.

ORCID profiles: James P Wilson, Vivi Thorup

Cite

APA

Wilson, J. P., Thorup, V., & Bell, N. J. (2026). Interobserver agreement when using a four‐point mobility scoring system to score dairy cattle from video footage. Veterinary Record, 199(3). https://doi.org/10.1002/vetr.70801

Vancouver

Wilson JP, Thorup V, Bell NJ. Interobserver agreement when using a four‐point mobility scoring system to score dairy cattle from video footage. Veterinary Record. 2026;199(3). doi:10.1002/vetr.70801

BibTeX
@article{Wilson2026,
  author = {Wilson, James P and Thorup, Vivi and Bell, Nick J},
  title = {Interobserver agreement when using a four‐point mobility scoring system to score dairy cattle from video footage},
  journal = {Veterinary Record},
  year = {2026},
  volume = {199},
  number = {3},
  doi = {10.1002/vetr.70801}
}
Start for free →