MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedback
ACM Transactions on Computer-Human Interaction · 31.10.2024 · 31 (5) · 1-41
DOI: 10.1145/3694681 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Computer-Human Interaction, online erschienen am 10.11.2024. Verfasst von Chen Chen und 4 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 109 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Providing asynchronous feedback is a critical step in the 3D design workflow. A common approach to providing feedback is to pair textual comments with companion reference images, which helps illustrate the gist of text. Ideally, feedback providers should possess 3D and image editing skills to create reference images that can effectively describe what they have in mind. However, they often lack such skills, so they have to resort to sketches or online images that might not match well with the current 3D design. To address this, we introduce MemoVis , a text editor interface that assists feedback providers in creating reference images with generative AI driven by the feedback comments. First, a novel real-time viewpoint suggestion feature, based on a vision-language foundation model, helps feedback providers anchor a comment with a camera viewpoint. Second, given a camera viewpoint, we introduce three types of image modifiers based on pre-trained 2D generative models to turn a text comment into an updated version of the 3D scene from that viewpoint. We conducted a within-subjects study with \(14\) feedback providers, demonstrating the effectiveness of MemoVis. The quality and explicitness of the companion images were evaluated by another eight participants with prior 3D design experience.
Zitieren
APA
Chen, C., Nguyen, C., Groueix, T., Kim, V. G., & Weibel, N. (2024). MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedback. ACM Transactions on Computer-Human Interaction, 31(5), 1-41. https://doi.org/10.1145/3694681
Vancouver
Chen C, Nguyen C, Groueix T, Kim VG, Weibel N. MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedback. ACM Transactions on Computer-Human Interaction. 2024;31(5):1-41. doi:10.1145/3694681
BibTeX
@article{Chen2024,
author = {Chen, Chen and Nguyen, Cuong and Groueix, Thibault and Kim, Vladimir G. and Weibel, Nadir},
title = {MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedback},
journal = {ACM Transactions on Computer-Human Interaction},
year = {2024},
volume = {31},
number = {5},
pages = {1--41},
doi = {10.1145/3694681}
}
EUVIMED