On the Evaluation Scheme for Large Scale Innovation Competition
Open Access Journal of Data Science and Artificial Intelligence · 2023
DOI: 10.23880/oajda-16000108 ↗Kurz gefasst
Fachartikel in der Zeitschrift Open Access Journal of Data Science and Artificial Intelligence, 2023. Verfasst von Zhao B*.
Abstract (Originalsprache)
Large-scale innovation contests are becoming increasingly popular globally, with many innovators and enterprises actively participating. Work allocation optimization and fair judging are two significant concerns in innovation contests. This academic paper aims to recommend an optimized "cross-assignment" program by leveraging the optimal objective function method to improve the comparability of scores given by various judges. We conducted data-based descriptive statistical analysis and concluded that the two-stage and weighted evaluation schemes are more beneficial than the traditional judging scheme. Nonetheless, there are still some shortcomings that require addressing. To enhance fairness, we propose an improved twostage evaluation scheme. In the first stage, we normalize the scores with a normal distribution. In the second stage of the process, we implement a system utilizing the Borda sorting technique to categorize submissions into five distinct groups for judges to evaluate based on their perceptions. We also detail a method for weighting tied scores to determine the final rankings. Testing indicates that this approach yields a Normalized Discounted Cumulative Gain (NDCG) of 0.8667, implying greater fairness and precision in the assessment of submissions.
Zitieren
APA
B*, Z. (2023). On the Evaluation Scheme for Large Scale Innovation Competition. Open Access Journal of Data Science and Artificial Intelligence. https://doi.org/10.23880/oajda-16000108
Vancouver
B* Z. On the Evaluation Scheme for Large Scale Innovation Competition. Open Access Journal of Data Science and Artificial Intelligence. 2023. doi:10.23880/oajda-16000108
BibTeX
@article{B2023,
author = {B*, Zhao},
title = {On the Evaluation Scheme for Large Scale Innovation Competition},
journal = {Open Access Journal of Data Science and Artificial Intelligence},
year = {2023},
doi = {10.23880/oajda-16000108}
}
EUVIMED