EUVIMEDEUVIMED entdecken
Crossref

The meritocratic degree of the Academic evaluation in Italy. Should artificial intelligence be used in this context?

Salvatore Chirumbolo

Top Italian Scientists Journal · 2025

DOI: 10.62684/anca8483 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Top Italian Scientists Journal, 2025. Verfasst von Salvatore Chirumbolo.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The increasing emphasis on publication quantity over quality in academic evaluation has raised concerns about the integrity of meritocratic assessments in Italy. This study explores the impact of Letters to the Editor (LTEs) and Correspondences on reputation indices, such as the h-index, and proposes an algorithm to minimize their disproportionate influence. The proliferation of AI tools, including machine learning and chatbots, has further complicated academic evaluation by enabling rapid manuscript production, potentially inflating publication counts without corresponding research depth. This paper introduces a weighted algorithm that adjusts the h-index by assigning lower weights to LTEs and Correspondences, based on predefined parameters. Using example datasets, the adjusted h-index significantly reduced scores compared to the original, reflecting more accurate merit assessments. Statistical analysis revealed a high correlation between original and adjusted h-indices (Pearson r = 0.98, Spearman r = 0.94), yet highlighted a weak correlation between letter contributions and rank order (r = -0.04). Paired t-tests confirmed significant differences between the two indices (p = 0.0393). The proposed method effectively penalizes superficial publications while preserving the value of full-length research articles. This approach offers a rigorous and mathematically grounded framework for evaluating academic productivity, particularly in high-stakes settings like Italy’s National Scientific Qualification competitions. Furthermore, integrating AI tools into evaluation systems could enhance transparency and fairness, reducing biases and legal disputes related to subjective judgments. Future research should refine these metrics for broader disciplinary applications, ensuring a balanced assessment of academic contributions in the era of artificial intelligence and automated publishing tools.

Zitieren

APA

Chirumbolo, S. (2025). The meritocratic degree of the Academic evaluation in Italy. Should artificial intelligence be used in this context?. Top Italian Scientists Journal. https://doi.org/10.62684/anca8483

Vancouver

Chirumbolo S. The meritocratic degree of the Academic evaluation in Italy. Should artificial intelligence be used in this context?. Top Italian Scientists Journal. 2025. doi:10.62684/anca8483

BibTeX
@article{Chirumbolo2025,
  author = {Chirumbolo, Salvatore},
  title = {The meritocratic degree of the Academic evaluation in Italy. Should artificial intelligence be used in this context?},
  journal = {Top Italian Scientists Journal},
  year = {2025},
  doi = {10.62684/anca8483}
}
Kostenlos starten →