EUVIMEDEUVIMED entdecken
Crossref

What Makes a Good Model Card?

Haochen Lu, Junxiao Han, Yujie Huang, Jiakun Liu, Lingfeng Bao, Song Han, David Lo, Shuiguang Deng

Journal of Software: Evolution and Process · 2026-10 · 38 (10)

DOI: 10.1002/smr.70170 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Software: Evolution and Process, online erschienen am 07.10.2026. Verfasst von Haochen Lu und 7 weiteren Autor:innen. Die Arbeit nennt 96 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Hugging Face (HF) is an increasingly popular platform for sharing and discovering machine learning (ML) and artificial intelligence (AI) models. Model cards document these models, and good model cards serve as a vital communication bridge between model developers and users. Without good model cards, it is challenging for users to understand the models and for developers to maintain them. Prior research focused on the documentation process and automatic generation of model cards, and identified the need for high‐quality datasets. Understanding the characteristics of good model cards can help improve the quality of model cards, which is essential for model developers and users. To address these gaps, we study the characteristics of high‐quality model cards. We collect 758 sampled models along with their model cards and adapt a prior framework to manually identify seven categories of content (i.e., categories of “What,” “Why,” “How,” “When,” “Who,” “References,” and “Other”) and their corresponding themes (e.g., “Model Description” in the “What” category) for these model cards. Then, we conduct a survey to explore what constitutes a high‐quality model card. After validation, we define a high‐quality model card as one that incorporates the “Model Overview” and “Model Evaluation” content themes from the “What” category, along with the “Model Usage Guide” content theme from the “How” category, that is, a model card that provides both a brief or detailed introduction to the model and instructions for its usage. Then, we train classifiers to investigate whether high‐quality model cards can be automatically identified. The random forest model achieves the best performance, with an ROC‐AUC of 94.57%. We also investigate the determinants of the quality of model cards. We find that the total word count of the content of model cards, the number of tables that show the key evaluation metrics and results, external links that show the references of external resources, and code blocks that are used to show examples of how to use the model are several of the most significant features that determine the quality of model cards. Finally, we explore the relationship between model card quality and model survival, and find that models with high‐quality model cards tend to remain active significantly longer than those with low‐quality model cards. Our findings provide insights into high‐quality model cards and practical suggestions for model developers, users, researchers, and the HF platform.

Zitieren

APA

Lu, H., Han, J., Huang, Y., Liu, J., Bao, L., Han, S., Lo, D., & Deng, S. (2026). What Makes a Good Model Card?. Journal of Software: Evolution and Process, 38(10). https://doi.org/10.1002/smr.70170

Vancouver

Lu H, Han J, Huang Y, Liu J, Bao L, Han S, et al. What Makes a Good Model Card?. Journal of Software: Evolution and Process. 2026;38(10). doi:10.1002/smr.70170

BibTeX
@article{Lu2026,
  author = {Lu, Haochen and Han, Junxiao and Huang, Yujie and Liu, Jiakun and Bao, Lingfeng and Han, Song and Lo, David and Deng, Shuiguang},
  title = {What Makes a Good Model Card?},
  journal = {Journal of Software: Evolution and Process},
  year = {2026},
  volume = {38},
  number = {10},
  doi = {10.1002/smr.70170}
}
Kostenlos starten →