DocXclassifier: towards a robust and interpretable deep neural network for document image classification
International Journal on Document Analysis and Recognition (IJDAR) · 2024-09 · 27 (3) · 447-473
DOI: 10.1007/s10032-024-00483-w ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal on Document Analysis and Recognition (IJDAR), online erschienen am 25.06.2024. Verfasst von Saifullah Saifullah und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 83 Literaturangaben.
Abstract (Originalsprache)
Model interpretability and robustness are becoming increasingly critical today for the safe and practical deployment of deep learning (DL) models in industrial settings. As DL-backed automated document processing systems become increasingly common in business workflows, there is a pressing need today to enhance interpretability and robustness for the task of document image classification, an integral component of such systems. Surprisingly, while much research has been devoted to improving the performance of deep models for this task, little attention has been given to their interpretability and robustness. In this paper, we aim to improve upon both aspects and introduce two inherently interpretable deep document classifiers, DocXClassifier and DocXClassifierFPN, both of which not only achieve significant performance improvements over existing approaches but also hold the capability to simultaneously generate feature importance maps while making their predictions. Our approach involves integrating a convolutional neural network (ConvNet) backbone with an attention mechanism to perform weighted aggregation of features based on their importance to the class, enabling the generation of interpretable importance maps. Additionally, we propose integrating Feature Pyramid Networks with the attention mechanism to significantly enhance the resolution of the interpretability maps, especially for pyramidal ConvNet architectures. Our approach attains state-of-the-art performance in image-based classification on two popular document datasets, RVL-CDIP and Tobacco3482, with top-1 classification accuracies of 94.19% and 95.71%, respectively. Additionally, it sets a new record for the highest image-based classification accuracy on Tobacco3482 without transfer learning from RVL-CDIP, at 90.29%. In addition, our proposed training strategy demonstrates superior robustness compared to existing approaches, significantly outperforming them on 19 out of 21 different types of novel data distortions, while achieving comparable results on the remaining two. By combining robustness with interpretability, DocXClassifier presents a promising step toward the practical deployment of DL models for document classification tasks.
Zitieren
APA
Saifullah, S., Agne, S., Dengel, A., & Ahmed, S. (2024). DocXclassifier: towards a robust and interpretable deep neural network for document image classification. International Journal on Document Analysis and Recognition (IJDAR), 27(3), 447-473. https://doi.org/10.1007/s10032-024-00483-w
Vancouver
Saifullah S, Agne S, Dengel A, Ahmed S. DocXclassifier: towards a robust and interpretable deep neural network for document image classification. International Journal on Document Analysis and Recognition (IJDAR). 2024;27(3):447-473. doi:10.1007/s10032-024-00483-w
BibTeX
@article{Saifullah2024,
author = {Saifullah, Saifullah and Agne, Stefan and Dengel, Andreas and Ahmed, Sheraz},
title = {DocXclassifier: towards a robust and interpretable deep neural network for document image classification},
journal = {International Journal on Document Analysis and Recognition (IJDAR)},
year = {2024},
volume = {27},
number = {3},
pages = {447--473},
doi = {10.1007/s10032-024-00483-w}
}
EUVIMED