Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections
Research Ideas and Outcomes · 28.08.2020 · 6
DOI: 10.3897/rio.6.e58030 ↗Kurz gefasst
Fachartikel in der Zeitschrift Research Ideas and Outcomes, online erschienen am 28.08.2020. Verfasst von David Owen und 7 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Commission, Horizon 2020.
Abstract (Originalsprache)
We describe an effective approach to automated text digitisation with respect to natural history specimen labels. These labels contain much useful data about the specimen including its collector, country of origin, and collection date. Our approach to automatically extracting these data takes the form of a pipeline. Recommendations are made for the pipeline's component parts based on state-of-the-art technologies. Optical Character Recognition (OCR) can be used to digitise text on images of specimens. However, recognising text quickly and accurately from these images can be a challenge for OCR. We show that OCR performance can be improved by prior segmentation of specimen images into their component parts. This ensures that only text-bearing labels are submitted for OCR processing as opposed to whole specimen images, which inevitably contain non-textual information that may lead to false positive readings. In our testing Tesseract OCR version 4.0.0 offers promising text recognition accuracy with segmented images. Not all the text on specimen labels is printed. Handwritten text varies much more and does not conform to standard shapes and sizes of individual characters, which poses an additional challenge for OCR. Recently, deep learning has allowed for significant advances in this area. Google's Cloud Vision, which is based on deep learning, is trained on large-scale datasets, and is shown to be quite adept at this task. This may take us some way towards negating the need for humans to routinely transcribe handwritten text. Determining the countries and collectors of specimens has been the goal of previous automated text digitisation research activities. Our approach also focuses on these two pieces of information. An area of Natural Language Processing (NLP) known as Named Entity Recognition (NER) has matured enough to semi-automate this task. Our experiments demonstrated that existing approaches can accurately recognise location and person names within the text extracted from segmented images via Tesseract version 4.0.0. We have highlighted the main recommendations for potential pipeline components. The paper also provides guidance on selecting appropriate software solutions. These include automatic language identification, terminology extraction, and integrating all pipeline components into a scientific workflow to automate the overall digitisation process.
Förderung
- European Commission
- Horizon 2020
Zitieren
APA
Owen, D., Groom, Q., Hardisty, A., Leegwater, T., Livermore, L., Walsum, M. V., Wijkamp, N., & Spasić, I. (2020). Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes, 6. https://doi.org/10.3897/rio.6.e58030
Vancouver
Owen D, Groom Q, Hardisty A, Leegwater T, Livermore L, Walsum MV, et al. Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes. 2020;6. doi:10.3897/rio.6.e58030
BibTeX
@article{Owen2020,
author = {Owen, David and Groom, Quentin and Hardisty, Alex and Leegwater, Thijs and Livermore, Laurence and Walsum, Myriam van and Wijkamp, Noortje and Spasić, Irena},
title = {Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections},
journal = {Research Ideas and Outcomes},
year = {2020},
volume = {6},
doi = {10.3897/rio.6.e58030}
}
EUVIMED