What Makes a Good Model Card?
Journal of Software: Evolution and Process · 2026-10 · 38 (10)
DOI: 10.1002/smr.70170 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Software: Evolution and Process, online erschienen am 07.10.2026. Verfasst von Haochen Lu und 7 weiteren Autor:innen. Die Arbeit nennt 96 Literaturangaben.
Abstract (Originalsprache)
Hugging Face (HF) is an increasingly popular platform for sharing and discovering machine learning (ML) and artificial intelligence (AI) models. Model cards document these models, and good model cards serve as a vital communication bridge between model developers and users. Without good model cards, it is challenging for users to understand the models and for developers to maintain them. Prior research focused on the documentation process and automatic generation of model cards, and identified the need for high‐quality datasets. Understanding the characteristics of good model cards can help improve the quality of model cards, which is essential for model developers and users. To address these gaps, we study the characteristics of high‐quality model cards. We collect 758 sampled models along with their model cards and adapt a prior framework to manually identify seven categories of content (i.e., categories of “What,” “Why,” “How,” “When,” “Who,” “References,” and “Other”) and their corresponding themes (e.g., “Model Description” in the “What” category) for these model cards. Then, we conduct a survey to explore what constitutes a high‐quality model card. After validation, we define a high‐quality model card as one that incorporates the “Model Overview” and “Model Evaluation” content themes from the “What” category, along with the “Model Usage Guide” content theme from the “How” category, that is, a model card that provides both a brief or detailed introduction to the model and instructions for its usage. Then, we train classifiers to investigate whether high‐quality model cards can be automatically identified. The random forest model achieves the best performance, with an ROC‐AUC of 94.57%. We also investigate the determinants of the quality of model cards. We find that the total word count of the content of model cards, the number of tables that show the key evaluation metrics and results, external links that show the references of external resources, and code blocks that are used to show examples of how to use the model are several of the most significant features that determine the quality of model cards. Finally, we explore the relationship between model card quality and model survival, and find that models with high‐quality model cards tend to remain active significantly longer than those with low‐quality model cards. Our findings provide insights into high‐quality model cards and practical suggestions for model developers, users, researchers, and the HF platform.
Zitieren
APA
Lu, H., Han, J., Huang, Y., Liu, J., Bao, L., Han, S., Lo, D., & Deng, S. (2026). What Makes a Good Model Card?. Journal of Software: Evolution and Process, 38(10). https://doi.org/10.1002/smr.70170
Vancouver
Lu H, Han J, Huang Y, Liu J, Bao L, Han S, et al. What Makes a Good Model Card?. Journal of Software: Evolution and Process. 2026;38(10). doi:10.1002/smr.70170
BibTeX
@article{Lu2026,
author = {Lu, Haochen and Han, Junxiao and Huang, Yujie and Liu, Jiakun and Bao, Lingfeng and Han, Song and Lo, David and Deng, Shuiguang},
title = {What Makes a Good Model Card?},
journal = {Journal of Software: Evolution and Process},
year = {2026},
volume = {38},
number = {10},
doi = {10.1002/smr.70170}
}
EUVIMED