EUVIMEDEUVIMED entdecken
Crossref

On the Evaluation Scheme for Large Scale Innovation Competition

Zhao B*

Open Access Journal of Data Science and Artificial Intelligence · 2023

DOI: 10.23880/oajda-16000108 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Open Access Journal of Data Science and Artificial Intelligence, 2023. Verfasst von Zhao B*.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large-scale innovation contests are becoming increasingly popular globally, with many innovators and enterprises actively participating. Work allocation optimization and fair judging are two significant concerns in innovation contests. This academic paper aims to recommend an optimized "cross-assignment" program by leveraging the optimal objective function method to improve the comparability of scores given by various judges. We conducted data-based descriptive statistical analysis and concluded that the two-stage and weighted evaluation schemes are more beneficial than the traditional judging scheme. Nonetheless, there are still some shortcomings that require addressing. To enhance fairness, we propose an improved twostage evaluation scheme. In the first stage, we normalize the scores with a normal distribution. In the second stage of the process, we implement a system utilizing the Borda sorting technique to categorize submissions into five distinct groups for judges to evaluate based on their perceptions. We also detail a method for weighting tied scores to determine the final rankings. Testing indicates that this approach yields a Normalized Discounted Cumulative Gain (NDCG) of 0.8667, implying greater fairness and precision in the assessment of submissions.

Zitieren

APA

B*, Z. (2023). On the Evaluation Scheme for Large Scale Innovation Competition. Open Access Journal of Data Science and Artificial Intelligence. https://doi.org/10.23880/oajda-16000108

Vancouver

B* Z. On the Evaluation Scheme for Large Scale Innovation Competition. Open Access Journal of Data Science and Artificial Intelligence. 2023. doi:10.23880/oajda-16000108

BibTeX
@article{B2023,
  author = {B*, Zhao},
  title = {On the Evaluation Scheme for Large Scale Innovation Competition},
  journal = {Open Access Journal of Data Science and Artificial Intelligence},
  year = {2023},
  doi = {10.23880/oajda-16000108}
}
Kostenlos starten →