EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

The Evolution of OCR-Free Visual Document Understanding: From Heuristic OCR to End-to-End Multimodal Transformers

Aarti Ahirwar, Ritu Tandon

International Journal of Research and Review in Applied Science, Humanities, and Technology · 02.04.2026 · 3 (2) · 85-93

DOI: 10.71143/gaza7e33 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Research and Review in Applied Science, Humanities, and Technology, online erschienen am 02.04.2026. Verfasst von Aarti Ahirwar und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visual Document Understanding (VDU) has undergone a seismic shift from multi-stage pipelines involving Optical Character Recognition (OCR) to end-to-end, pixel-to-text multimodal transformers. Traditional methods relied heavily on the accuracy of off-the-shelf OCR engines to provide textual inputs for downstream NLP models, creating a systemic vulnerability known as OCR error propagation. This paper provides a comprehensive review of the emerging OCR-free paradigm. We dissect the architectural transition from Layout-aware Transformers to pure Vision Transformers (ViT), hierarchical structures like Swin, and generative frameworks such as Donut and Pix2Struct. We analyze the core technical challenges, including the high-resolution bottleneck and cross-modal alignment, while evaluating state-of-the-art performance across industry-standard benchmarks. Finally, we propose future research trajectories in the context of Large Multimodal Models (LMMs).

Zitieren

APA

Ahirwar, A., & Tandon, R. (2026). The Evolution of OCR-Free Visual Document Understanding: From Heuristic OCR to End-to-End Multimodal Transformers. International Journal of Research and Review in Applied Science, Humanities, and Technology, 3(2), 85-93. https://doi.org/10.71143/gaza7e33

Vancouver

Ahirwar A, Tandon R. The Evolution of OCR-Free Visual Document Understanding: From Heuristic OCR to End-to-End Multimodal Transformers. International Journal of Research and Review in Applied Science, Humanities, and Technology. 2026;3(2):85-93. doi:10.71143/gaza7e33

BibTeX
@article{Ahirwar2026,
  author = {Ahirwar, Aarti and Tandon, Ritu},
  title = {The Evolution of OCR-Free Visual Document Understanding: From Heuristic OCR to End-to-End Multimodal Transformers},
  journal = {International Journal of Research and Review in Applied Science, Humanities, and Technology},
  year = {2026},
  volume = {3},
  number = {2},
  pages = {85--93},
  doi = {10.71143/gaza7e33}
}
Kostenlos starten →