Human perception and machine vision reveal rich latent structure in human figure drawings
Frontiers in Psychology · 23.02.2023 · 14
DOI: 10.3389/fpsyg.2023.1029808 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Psychology, online erschienen am 23.02.2023. Verfasst von Clint A Jensen und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Wisconsin-Madison, Madison, WI, United States. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
For over a hundred years, children’s drawings have been used to assess children’s intellectual, emotional, and physical development, characterizing children on the basis of intuitively derived checklists to identify the presence or absence of features within children’s drawings. The current study investigates whether contemporary data science tools, including deep neural network models of vision and crowd-based similarity ratings, can reveal latent structure in human figure drawings beyond that captured by checklists, and whether such structure can aid in understanding aspects of the child’s cognitive, perceptual, and motor competencies. We introduce three new metrics derived from innovations in machine vision and crowd-sourcing of human judgments and show that they capture a wealth of information about the participant beyond that expressed by standard measures, including age, gender, motor abilities, personal/social behaviors, and communicative skills. Machine-and human-derived metrics captured somewhat different aspects of structure across drawings, and each were independently useful for predicting some participant characteristics. For example, machine embeddings seemed sensitive to the magnitude of the drawing on the page and stroke density, while human-derived embeddings appeared sensitive to the overall shape and parts of a drawing. Both metrics, however, independently explained variation on some outcome measures. Machine embeddings explained more variation than human embeddings on all subscales of the Ages and Stages Questionnaire (a parent report of developmental milestones) and on measures of grip and pinch strength, while each metric accounted for unique variance in models predicting the participant’s gender. This research thus suggests that children’s drawings may provide a richer basis for characterizing aspects of cognitive, behavioral, and motor development than previously thought.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychology, University of Wisconsin-Madison, Madison, WI, United States.
- Department of Brain and Cognitive Science, University of Rochester, Rochester, NY, United States.
- Department of Psychology, University of Rochester, Rochester, NY, United States.
- Department of Human Development and Family Studies, University of Wisconsin-Madison, Madison, WI, United States.
- Occupational Therapy Program, Department of Kinesiology, Waisman Center, University of Wisconsin-Madison, Madison, WI, United States.
Zitieren
APA
Jensen, C. A., Sumanthiran, D., Kirkorian, H. L., Travers, B. G., Rosengren, K. S., & Rogers, T. T. (2023). Human perception and machine vision reveal rich latent structure in human figure drawings. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1029808
Vancouver
Jensen CA, Sumanthiran D, Kirkorian HL, Travers BG, Rosengren KS, Rogers TT. Human perception and machine vision reveal rich latent structure in human figure drawings. Frontiers in Psychology. 2023;14. doi:10.3389/fpsyg.2023.1029808
BibTeX
@article{Jensen2023,
author = {Jensen, Clint A and Sumanthiran, Dillanie and Kirkorian, Heather L and Travers, Brittany G and Rosengren, Karl S and Rogers, Timothy T},
title = {Human perception and machine vision reveal rich latent structure in human figure drawings},
journal = {Frontiers in Psychology},
year = {2023},
volume = {14},
doi = {10.3389/fpsyg.2023.1029808}
}
EUVIMED