EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Inter‐Rater Disagreements in Applying the Montreal Classification for Crohn's Disease: The Five‐Nations Survey Study

Offir Ukashi iD, Aurelien Amiot, David Laharie, Luis Menchén, Ana Gutiérrez, Samuel Fernandes iD, Tommaso Pessarelli iD, Fábio Correia iD, Carlos Gonzalez-Muñoza iD, Julia López-Cardona, Giulio Calabrese, Rocio Ferreiro-Iglesias iD und 33 weitere

United European Gastroenterology Journal · 2025-06 · 13 (5) · 685-696

DOI: 10.1002/ueg2.12757 ↗

Kurz gefasst

Fachartikel in der Zeitschrift United European Gastroenterology Journal, online erschienen am 18.01.2025. Verfasst von Offir Ukashi und 44 weiteren Autor:innen. Beteiligte Einrichtung: Sheba Medical Center, Institute of Gastroenterology, Ramat-Gan, Israel. Hauptthemen laut MEDLINE: Crohn Disease, Gastroenterologists, Gastroenterology. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The Montreal classification has been widely used in Crohn's disease since 2005 to categorize patients by the age of onset (A), disease location (L), behavior (B), and upper gastrointestinal tract and perianal involvement. With evolving management paradigms in Crohn's disease, we aimed to assess the performance of gastroenterologists in applying the Montreal classification.

Methods

An online survey was conducted among participants at an international educational conference on inflammatory bowel diseases. Participants classified 20 theoretical Crohn's disease cases using the Montreal classification. Agreement rates with the inflammatory bowel diseases board (three expert gastroenterologists whose consensus rating was considered the gold standard) were calculated for gastroenterologist specialists and fellows/specialists with ≤ 2 years of clinical experience. A majority vote < 75% among participants was considered a notable disagreement. The same cases were classified using three large language models (LLMs), ChatGPT‐4, Claude‐3, and Gemini‐1.5, and assessed for agreement with the board and gastroenterologists. Fleiss Kappa was used to assess within‐group agreement.

Results

Thirty‐eight participants from five countries completed the survey. In defining the Montreal classification as a whole, specialists (21/38 [55%]) had a higher agreement rate with the board compared to fellows/young specialists (17/38 [45%]) (58% vs. 49%, p = 0.012) and to LLMs (58% vs. 18%, p < 0.001). Disease behavior classification was the most challenging, with 76% agreement among specialists and fellows/young specialists and 48% among LLMs compared to the inflammatory bowel diseases board. Regarding disease behavior, within‐group agreement was moderate (specialists: k = 0.522, fellows/young specialists: k = 0.532, LLMs: k = 0.577; p < 0.001 for all). Notable points of disagreement included: defining disease behavior concerning obstructive symptoms, assessing disease extent via video capsule endoscopy, and evaluating treatment‐related reversibility of the disease phenotype.

Conclusions

There is significant inter‐rater disagreement in applying the Montreal classification, particularly for disease behavior in Crohn's disease. Improved education or revisions to phenotype criteria may be needed to enhance consensus on the Montreal classification.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Crohn DiseaseGastroenterologistsGastroenterologyHumansConsensusSurveys and QuestionnairesObserver VariationFemaleMaleSeverity of Illness IndexAdultAge of Onset

Stichwörter der Autor:innen

Crohn's diseasecomplicated disease phenotypeinflammatory bowel diseaseslarge language modelsmontreal classification

Autor:innen und Institutionen

  • Sheba Medical Center, Institute of Gastroenterology, Ramat-Gan, Israel.
  • Faculty of Medical and Health Sciences, Tel-Aviv University, Tel-Aviv, Israel.
  • Department of Gastroenterology, Hopitaux Universitaires Bicêtre, AP-HP, Université Paris Saclay, INSERM U1018 CESP, Le Kremlin Bicêtre, France.
  • CHU de Bordeaux, Centre Medico-Chirurgical Magellan, Gastroenterology Department, Hôpital Haut-Lévêque, Université de Bordeaux, INSERM CIC 1401, Bordeaux, France.
  • Hospital General Universitario - Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain.
  • Departamento de Medicina, Universidad Complutense, Madrid, Spain.

ORCID-Profile: Offir Ukashi, Samuel Fernandes, Tommaso Pessarelli, Fábio Correia, Carlos Gonzalez-Muñoza, Rocio Ferreiro-Iglesias, Raquel Oliveira, Kassem Sharif, Shomron Ben-Horin, Carlos Soutullo-Castiñeiras, Agnese Favale, Louis Calméjane, Alfonso Elosua, Sara Lopes, Violeta Mauriz, Helena Tavares de Sousa, Lorenzo Bertani, Yamile Zabana, Anna Viola, Manuel Barreiro-de Acosta, Henit Yanai, Uri Kopylov

Zitieren

APA

Ukashi, O., Amiot, A., Laharie, D., Menchén, L., Gutiérrez, A., Fernandes, S., Pessarelli, T., Correia, F., Gonzalez-Muñoza, C., López-Cardona, J., Calabrese, G., Ferreiro-Iglesias, R., Tamir-Degabli, N., Dussias, N. K., Mousa, A., Oliveira, R., Richard, N., Veisman, I., Sharif, K., …, & Kopylov, U. (2025). Inter‐Rater Disagreements in Applying the Montreal Classification for Crohn's Disease: The Five‐Nations Survey Study. United European Gastroenterology Journal, 13(5), 685-696. https://doi.org/10.1002/ueg2.12757

Vancouver

Ukashi O, Amiot A, Laharie D, Menchén L, Gutiérrez A, Fernandes S, et al. Inter‐Rater Disagreements in Applying the Montreal Classification for Crohn's Disease: The Five‐Nations Survey Study. United European Gastroenterology Journal. 2025;13(5):685-696. doi:10.1002/ueg2.12757

BibTeX
@article{Ukashi2025,
  author = {Ukashi, Offir and Amiot, Aurelien and Laharie, David and Menchén, Luis and Gutiérrez, Ana and Fernandes, Samuel and Pessarelli, Tommaso and Correia, Fábio and Gonzalez-Muñoza, Carlos and López-Cardona, Julia and Calabrese, Giulio and Ferreiro-Iglesias, Rocio and Tamir-Degabli, Natalie and Dussias, Nikolas Konstantine and Mousa, Amjad and Oliveira, Raquel and Richard, Nicolas and Veisman, Ido and Sharif, Kassem and Ben-Horin, Shomron and Soutullo-Castiñeiras, Carlos and Dragoni, Gabriele and Rotulo, Silvia and Favale, Agnese and Calméjane, Louis and Bazin, Thomas and Elosua, Alfonso and Lopes, Sara and Felice, Carla and Mauriz, Violeta and Rodrigues, Inês Coelho and Jougon, Julia and Botto, Inês and Tavares de Sousa, Helena and Bertani, Lorenzo and Abadía, Paula Ripoll and Bernardi, Alice De and Zabana, Yamile and Serra-Ruiz, Xavier and Viola, Anna and Barreiro-de Acosta, Manuel and Yanai, Henit and Armuzzi, Alessandro and Magro, Fernando and Kopylov, Uri},
  title = {Inter‐Rater Disagreements in Applying the Montreal Classification for Crohn's Disease: The Five‐Nations Survey Study},
  journal = {United European Gastroenterology Journal},
  year = {2025},
  volume = {13},
  number = {5},
  pages = {685--696},
  doi = {10.1002/ueg2.12757}
}
Kostenlos starten →