EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Assessing the Consistency and Reliability of WAVE, ARC Toolkit, and IBM Equal Access Toolkit under WCAG 2.2: Evidence from Saudi E-Government Services

Mohammed O. Alannsary

The Saudi Journal of Applied Sciences and Technology · 20.06.2026 · 3 (1)

DOI: 10.63908/rmgh1612 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Saudi Journal of Applied Sciences and Technology, online erschienen am 20.06.2026. Verfasst von Mohammed O. Alannsary. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated web accessibility testing tools are commonly used to assess compliance with the Web Content Accessibility Guidelines (WCAG); however, limited research has examined their consistency and reliability when applied to real-world systems. This study presents a comparative evaluation of three commonly used tools, namely the WAVE Tool, the ARC Toolkit, and the IBM Equal Access Toolkit, using e-government service web pages provided by the Ministry of Human Resources and Social Development in Saudi Arabia. The analysis examines differences in detected accessibility issues across tools, including violations, errors, alerts, and recommendations. Descriptive analysis revealed substantial differences in detected issue counts, with mean adjusted counts of 589.22 for WAVE, 287.78 for IBM Equal Access Toolkit, and 68.22 for ARC Toolkit. Pearson correlation analysis indicated strong correlation between IBM and WAVE (r = 0.969), a moderate correlation between IBM and ARC (r = 0.687), and a moderate correlation between ARC and WAVE (r = 0.651), reflecting partial but limited agreement between tools. WAVE reported the highest number of issues when all categories were included; however, adjusted analysis excluding ARIA-related issues indicates that these differences are primarily influenced by variations in reporting structures rather than detection capability alone. The results further indicate that the other tools produced more constrained and narrowly scoped outputs, demonstrating the tool-dependent nature of automated accessibility evaluation. The study suggests that reliance on a single tool may result in an incomplete accessibility assessment and therefore supports the use of multi-tool approaches complemented by manual inspection. The findings offer practical insights for improving accessibility evaluation practices in digital services.

Zitieren

APA

Alannsary, M. O. (2026). Assessing the Consistency and Reliability of WAVE, ARC Toolkit, and IBM Equal Access Toolkit under WCAG 2.2: Evidence from Saudi E-Government Services. The Saudi Journal of Applied Sciences and Technology, 3(1). https://doi.org/10.63908/rmgh1612

Vancouver

Alannsary MO. Assessing the Consistency and Reliability of WAVE, ARC Toolkit, and IBM Equal Access Toolkit under WCAG 2.2: Evidence from Saudi E-Government Services. The Saudi Journal of Applied Sciences and Technology. 2026;3(1). doi:10.63908/rmgh1612

BibTeX
@article{Alannsary2026,
  author = {Alannsary, Mohammed O.},
  title = {Assessing the Consistency and Reliability of WAVE, ARC Toolkit, and IBM Equal Access Toolkit under WCAG 2.2: Evidence from Saudi E-Government Services},
  journal = {The Saudi Journal of Applied Sciences and Technology},
  year = {2026},
  volume = {3},
  number = {1},
  doi = {10.63908/rmgh1612}
}
Kostenlos starten →