Enhancing Cognitive Accessibility in Mobile Apps via LLM-driven Redundant Entry Reduction
ACM Transactions on Software Engineering and Methodology · 22.05.2026
DOI: 10.1145/3816705 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 22.05.2026. Verfasst von Mengxi Zhang und 5 weiteren Autor:innen. Die Arbeit nennt 48 Literaturangaben.
Abstract (Originalsprache)
Currently, mobile applications (apps) have become indispensable in our daily lives, supporting activities such as online shopping, scheduling, and health management. However, users frequently encounter redundant information entries, where identical data like dates, addresses, or preferences must be repeatedly entered across multiple Graphical User Interfaces (GUIs) or sessions. This problem not only increases interaction effort and user frustration but also disproportionately affects individuals with cognitive impairments, who may experience difficulty remembering or managing redundant entries. Traditionally, developers often rely on static field mappings and predefined rules to automatically fill such redundant entries, which are frequently inflexible, failing to adapt to diverse app layouts, dynamic interface elements, or individual user needs. To address this challenge, we propose LLM-DIP, the first large language model (LLM)-driven framework that automatically detects and fills non-sensitive redundant entries by leveraging a multimodal understanding of GUI screenshots and layout structures. We evaluated LLM-DIP on 100 Android apps across 17 domains, achieving an average accuracy of 91.6% and F1-score of 91.0%, which outperforms the existing baselines. Additionally, a user study involving 20 participants with cognitive impairments confirmed its practical benefits, demonstrating increased input efficiency and high user satisfaction (average rating: 4.3/5).
Zitieren
APA
Zhang, M., Xiong, Y., Cheng, X., Liu, Y., Liu, R., & Chen, Z. (2026). Enhancing Cognitive Accessibility in Mobile Apps via LLM-driven Redundant Entry Reduction. ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3816705
Vancouver
Zhang M, Xiong Y, Cheng X, Liu Y, Liu R, Chen Z. Enhancing Cognitive Accessibility in Mobile Apps via LLM-driven Redundant Entry Reduction. ACM Transactions on Software Engineering and Methodology. 2026. doi:10.1145/3816705
BibTeX
@article{Zhang2026,
author = {Zhang, Mengxi and Xiong, Yongju and Cheng, Xianyou and Liu, Yihao and Liu, Ran and Chen, Zhanlong},
title = {Enhancing Cognitive Accessibility in Mobile Apps via LLM-driven Redundant Entry Reduction},
journal = {ACM Transactions on Software Engineering and Methodology},
year = {2026},
doi = {10.1145/3816705}
}
EUVIMED