An Empirical Analysis of Machine Learning Model and Dataset Documentation, Supply Chain, and Licensing Challenges on Hugging Face
ACM Transactions on Software Engineering and Methodology · 31.08.2026 · 35 (8) · 1-49
DOI: 10.1145/3776739 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 16.07.2026. Verfasst von Trevor Stalnaker und 6 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 119 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-SA 4.0). Gefördert von: National Science Foundation.
Abstract (Originalsprache)
The last decade has seen widespread adoption of Machine Learning (ML) components in software systems. This has occurred in nearly every domain, from natural language processing to computer vision. These ML components range from relatively simple neural networks to complex and resource-intensive large language models. However, despite this widespread adoption, little is known about the supply chain relationships that produce these models, which can have implications for compliance and security. In this work, we conducted an extensive analysis of 760,460 models and 175,000 datasets extracted from the popular model-sharing site Hugging Face. First, we evaluate the current state of documentation in the Hugging Face supply chain, report real-world examples of shortcomings, and offer actionable suggestions for improvement. Next, we analyze the underlying structure of the existing supply chain. Finally, we explore the current licensing landscape against what was reported in previous work and discuss the unique challenges posed in this domain. Our results motivate multiple research avenues, including the need for better license management for ML models/datasets, better support for model documentation, and automated inconsistency checking and validation. We make our research infrastructure and dataset available to facilitate future research.
Förderung
- National Science Foundation
Zitieren
APA
Stalnaker, T., Wintersgill, N., Chaparro, O., Heymann, L. A., Penta, M. D., German, D. M., & Poshyvanyk, D. (2026). An Empirical Analysis of Machine Learning Model and Dataset Documentation, Supply Chain, and Licensing Challenges on Hugging Face. ACM Transactions on Software Engineering and Methodology, 35(8), 1-49. https://doi.org/10.1145/3776739
Vancouver
Stalnaker T, Wintersgill N, Chaparro O, Heymann LA, Penta MD, German DM, et al. An Empirical Analysis of Machine Learning Model and Dataset Documentation, Supply Chain, and Licensing Challenges on Hugging Face. ACM Transactions on Software Engineering and Methodology. 2026;35(8):1-49. doi:10.1145/3776739
BibTeX
@article{Stalnaker2026,
author = {Stalnaker, Trevor and Wintersgill, Nathan and Chaparro, Oscar and Heymann, Laura A. and Penta, Massimiliano Di and German, Daniel M. and Poshyvanyk, Denys},
title = {An Empirical Analysis of Machine Learning Model and Dataset Documentation, Supply Chain, and Licensing Challenges on Hugging Face},
journal = {ACM Transactions on Software Engineering and Methodology},
year = {2026},
volume = {35},
number = {8},
pages = {1--49},
doi = {10.1145/3776739}
}
EUVIMED