EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Making Implicit Weights Visible: An AHP-Based Approach to Criteria Aggregation in Research Quality Evaluation

Tindaro Cicero

Publications · 11.11.2026 · 14 (4) · 79

DOI: 10.3390/publications14040079 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Publications, online erschienen am 11.11.2026. Verfasst von Tindaro Cicero. Die Arbeit nennt 90 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In national research assessment, peer reviewers must collapse heterogeneous criteria into a single judgment, the source of what the literature calls commensuration bias. This paper integrates the absolute measurement variant of the Analytic Hierarchy Process (AHP) into Italy’s Research Quality Evaluation (VQR): pairwise comparisons derive panel-specific weights for three criteria (Originality, Methodology, Impact) and ten sub-criteria, while publications are scored directly on the sub-criteria and aggregated additively. The framework does not eliminate commensuration bias; it constrains and documents it at the aggregation stage, leaving a residual component in sub-criterion scoring. The framework also includes a ranking stability audit, a Monte Carlo procedure assessing how sensitive results are to weighting and scoring uncertainty. In an illustrative simulation of 20 publications, explicit weighting shifts 15 publications relative to an unweighted mean (1.25 positions on average across the 20 publications). Under the specified perturbations, rankings are stable when consistent pairwise judgments are perturbed (mean Spearman ρ ≥ 0.97) and more sensitive to scoring noise (mean ρ down to 0.81), but weight uncertainty gains importance as sub-criterion profiles become less correlated. The study is a proof of concept; empirical validation with real VQR data is left to future research.

Zitieren

APA

Cicero, T. (2026). Making Implicit Weights Visible: An AHP-Based Approach to Criteria Aggregation in Research Quality Evaluation. Publications, 14(4), 79. https://doi.org/10.3390/publications14040079

Vancouver

Cicero T. Making Implicit Weights Visible: An AHP-Based Approach to Criteria Aggregation in Research Quality Evaluation. Publications. 2026;14(4):79. doi:10.3390/publications14040079

BibTeX
@article{Cicero2026,
  author = {Cicero, Tindaro},
  title = {Making Implicit Weights Visible: An AHP-Based Approach to Criteria Aggregation in Research Quality Evaluation},
  journal = {Publications},
  year = {2026},
  volume = {14},
  number = {4},
  pages = {79},
  doi = {10.3390/publications14040079}
}
Kostenlos starten →