Investigating the Effect of Visualization Literacy and Guidance on Teachers' Dashboard Interpretation
Journal of Learning Analytics · 18.12.2024 · 12 (1) · 367-390
DOI: 10.18608/jla.2024.8471 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Learning Analytics, online erschienen am 18.12.2024. Verfasst von Stanislav Pozdniakov und 5 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Recent research on learning analytics dashboards has focused on designing user interfaces that offer various forms of visualization guidance (often referring to notions such as data storytelling or narrative visualization) to teachers (e.g., emphasizing data points or trends with colour and adding annotations), aiding them in interpreting visual elements to gain a comprehensive understanding of students’ learning processes. Yet, while some studies have explored how teachers interpret students’ data through these dashboards, many have overlooked the diverse technical capabilities of teachers, which can significantly impact their use of LA dashboards. In particular, visualization literacy (VL) skills can greatly influence how effectively teachers interpret dashboards. To the best of our knowledge, no comprehensive account exists that details how teachers with varying VL skills interpret visual representations of students’ data. In this paper, we address this gap by investigating how teachers interpret LA dashboards, both with and without visualization guidance, taking into account their VL. We illustrate this by analyzing teachers’ think-aloud sessions as they engage with dashboards in the context of monitoring synchronous online learning tasks undertaken by student groups using Zoom and Google Docs. Using epistemic network analysis, we examine the differences in interpretations between teachers with varying VL levels. Our findings revealed that teachers with low VL exhibited shallower dashboard interpretations than those with high VL. However, the association of VL with successful task completion rate was not significant. Also, visualization guidance did not enable teachers to deepen their interpretations. While some visualization guidance helped teachers to complete tasks correctly, excessive visualization guidance can also be detrimental.
Zitieren
APA
Pozdniakov, S., Martinez-Maldonado, R., Tsai, Y., Echeverria, V., Swiecki, Z., & Gašević, D. (2024). Investigating the Effect of Visualization Literacy and Guidance on Teachers' Dashboard Interpretation. Journal of Learning Analytics, 12(1), 367-390. https://doi.org/10.18608/jla.2024.8471
Vancouver
Pozdniakov S, Martinez-Maldonado R, Tsai Y, Echeverria V, Swiecki Z, Gašević D. Investigating the Effect of Visualization Literacy and Guidance on Teachers' Dashboard Interpretation. Journal of Learning Analytics. 2024;12(1):367-390. doi:10.18608/jla.2024.8471
BibTeX
@article{Pozdniakov2024,
author = {Pozdniakov, Stanislav and Martinez-Maldonado, Roberto and Tsai, Yi-Shan and Echeverria, Vanessa and Swiecki, Zachari and Gašević, Dragan},
title = {Investigating the Effect of Visualization Literacy and Guidance on Teachers' Dashboard Interpretation},
journal = {Journal of Learning Analytics},
year = {2024},
volume = {12},
number = {1},
pages = {367--390},
doi = {10.18608/jla.2024.8471}
}
EUVIMED