EUVIMEDEUVIMED entdecken
Crossref

An Empirical Study on Evaluating Accessible Code Generation Capabilities of LLMs

Hyunjae Suh, Mahan Tafreshipour, Sam Malek, Iftekhar Ahmed

ACM Transactions on Software Engineering and Methodology · 12.06.2026

DOI: 10.1145/3820782 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 12.06.2026. Verfasst von Hyunjae Suh und 3 weiteren Autor:innen. Die Arbeit nennt 83 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Web accessibility is essential for inclusive digital experiences, yet the accessibility of LLM-generated code remains underexplored. This paper presents an empirical study comparing the accessibility of web code generated by GPT-4o, Qwen2.5-Coder-32B-Instruct-AWQ, and Gemini-3-Flash against human-written code. Results show that LLMs often produce more accessible code, especially for basic features like color contrast and alternative text, but struggle with complex issues such as ARIA attributes. We also assess advanced prompting strategies (Zero-Shot, Few-Shot, Self-Criticism), finding they offer some gains but are limited. To address these gaps, we introduce FeedA11y , a feedback-driven ReAct-based approach that demonstrates the potential of incorporating accessibility evaluation results into the code generation process. Our work highlights the promise of LLMs for accessible code generation and emphasizes the need for feedback-based techniques to address persistent challenges. We provide the source code and datasets that were used in our experiments in the companion website [15].

Zitieren

APA

Suh, H., Tafreshipour, M., Malek, S., & Ahmed, I. (2026). An Empirical Study on Evaluating Accessible Code Generation Capabilities of LLMs. ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3820782

Vancouver

Suh H, Tafreshipour M, Malek S, Ahmed I. An Empirical Study on Evaluating Accessible Code Generation Capabilities of LLMs. ACM Transactions on Software Engineering and Methodology. 2026. doi:10.1145/3820782

BibTeX
@article{Suh2026,
  author = {Suh, Hyunjae and Tafreshipour, Mahan and Malek, Sam and Ahmed, Iftekhar},
  title = {An Empirical Study on Evaluating Accessible Code Generation Capabilities of LLMs},
  journal = {ACM Transactions on Software Engineering and Methodology},
  year = {2026},
  doi = {10.1145/3820782}
}
Kostenlos starten →