EUVIMEDEUVIMED entdecken
Crossref

On the suitability of hugging face hub for empirical studies

Adem Ait, Javier Luis Cánovas Izquierdo, Jordi Cabot

Empirical Software Engineering · 2025-03 · 30 (2)

DOI: 10.1007/s10664-024-10608-8 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Empirical Software Engineering, online erschienen am 18.01.2025. Verfasst von Adem Ait und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 90 Literaturangaben. Gefördert von: Ministerio de Ciencia e Innovación, Fonds National de la Recherche Luxembourg.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Empirical studies in software engineering mainly rely on the data available on code-hosting platforms, being GitHub the most representative. Nevertheless, in the last years, the emergence of Machine Learning (ML) has led to the development of platforms specifically designed for hosting ML-based projects, with Hugging Face Hub (HFH) as the most popular one. So far, there have been no studies evaluating the potential of HFH for such studies. We aim at performing an exploratory study of the current state of HFH and its suitability to be used as a source platform for empirical studies. We conduct a qualitative and quantitative analysis of HFH. The former will be performed by comparing the features of HFH with those of other code-hosting platforms, such as GitHub and GitLab. The latter will be performed by analyzing the data available in HFH. We propose a feature framework to characterize HFH and report on the current usage of the platform, both in terms of number and types of projects (and surrounding community) and the features they mostly rely on. The results confirm that HFH offers enough features and diverse enough data to be the source of relevant empirical studies on the development, evolution and usage of AI-related projects. The results also triggered a discussion on aspects of HFH that should be considered when performing such empirical studies.

Förderung

  • Ministerio de Ciencia e Innovación
  • Fonds National de la Recherche Luxembourg

Zitieren

APA

Ait, A., Izquierdo, J. L. C., & Cabot, J. (2025). On the suitability of hugging face hub for empirical studies. Empirical Software Engineering, 30(2). https://doi.org/10.1007/s10664-024-10608-8

Vancouver

Ait A, Izquierdo JLC, Cabot J. On the suitability of hugging face hub for empirical studies. Empirical Software Engineering. 2025;30(2). doi:10.1007/s10664-024-10608-8

BibTeX
@article{Ait2025,
  author = {Ait, Adem and Izquierdo, Javier Luis Cánovas and Cabot, Jordi},
  title = {On the suitability of hugging face hub for empirical studies},
  journal = {Empirical Software Engineering},
  year = {2025},
  volume = {30},
  number = {2},
  doi = {10.1007/s10664-024-10608-8}
}
Kostenlos starten →