Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practices
ACM Transactions on Computing Education · 30.06.2024 · 24 (2) · 1-37
DOI: 10.1145/3641552 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Computing Education, online erschienen am 16.04.2024. Verfasst von Tiffany Tseng und 7 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 85 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Machine learning (ML) models are fundamentally shaped by data, and building inclusive ML systems requires significant considerations around how to design representative datasets. Yet, few novice-oriented ML modeling tools are designed to foster hands-on learning of dataset design practices, including how to design for data diversity and inspect for data quality. To this end, we outline a set of four data design practices (DDPs) for designing inclusive ML models and share how we designed a tablet-based application called Co-ML to foster learning of DDPs through a collaborative ML model building experience. With Co-ML, beginners can build image classifiers through a distributed experience where data is synchronized across multiple devices, enabling multiple users to iteratively refine ML datasets in discussion and coordination with their peers. We deployed Co-ML in a 2-week-long educational AIML Summer Camp, where youth ages 13–18 worked in groups to build custom ML-powered mobile applications. Our analysis reveals how multi-user model building with Co-ML, in the context of student-driven projects created during the summer camp, supported development of DDPs including incorporating data diversity, evaluating model performance, and inspecting for data quality. Additionally, we found that students’ attempts to improve model performance often prioritized learnability over class balance. Through this work, we highlight how the combination of collaboration, model testing interfaces, and student-driven projects can empower learners to actively engage in exploring the role of data in ML systems.
Zitieren
APA
Tseng, T., Davidson, M. J., Morales-Navarro, L., Chen, J. K., Delaney, V., Leibowitz, M., Beason, J., & Shapiro, R. B. (2024). Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practices. ACM Transactions on Computing Education, 24(2), 1-37. https://doi.org/10.1145/3641552
Vancouver
Tseng T, Davidson MJ, Morales-Navarro L, Chen JK, Delaney V, Leibowitz M, et al. Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practices. ACM Transactions on Computing Education. 2024;24(2):1-37. doi:10.1145/3641552
BibTeX
@article{Tseng2024,
author = {Tseng, Tiffany and Davidson, Matt J. and Morales-Navarro, Luis and Chen, Jennifer King and Delaney, Victoria and Leibowitz, Mark and Beason, Jazbo and Shapiro, R. Benjamin},
title = {Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practices},
journal = {ACM Transactions on Computing Education},
year = {2024},
volume = {24},
number = {2},
pages = {1--37},
doi = {10.1145/3641552}
}
EUVIMED