A finely tuned deep transfer learning algorithm to compare outsole images
Statistical Analysis and Data Mining: The ASA Data Science Journal · 2023-12 · 16 (6) · 511-527
DOI: 10.1002/sam.11636 ↗Kurz gefasst
Fachartikel in der Zeitschrift Statistical Analysis and Data Mining: The ASA Data Science Journal, online erschienen am 28.07.2023. Verfasst von Moonsoo Jang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: Center for Statistics and Applications in Forensic Evidence.
Abstract (Originalsprache)
In forensic practice, evaluating shoeprint evidence is challenging because the differences between images of two different outsoles can be subtle. In this paper, we propose a deep transfer learning‐based matching algorithm called the Shoe‐MS algorithm that quantifies the similarity between two outsole images. The Shoe‐MS algorithm consists of a Siamese neural network for two input images followed by a transfer learning component to extract features from outsole impression images. The added layers are finely tuned using images of shoe soles. To test the performance of the method we propose, we use a study dataset that is both realistic and challenging. The pairs of images for which we know ground truth include (1) close non‐matches and (2) mock‐crime scene pairs. The Shoe‐MS algorithm performed well in terms of prediction accuracy and was able to determine the source of pairs of outsole images, even when comparisons were challenging. When using a score‐based likelihood ratio, the algorithm made the correct decision with high probability in a test of the hypothesis that images had a common source. An important advantage of the proposed approach is that pairs of images can be compared without alignment. In initial tests, Shoe‐MS exhibited better‐discriminating power than existing methods.
Förderung
- Center for Statistics and Applications in Forensic Evidence
Zitieren
APA
Jang, M., Park, S., & Carriquiry, A. (2023). A finely tuned deep transfer learning algorithm to compare outsole images. Statistical Analysis and Data Mining: The ASA Data Science Journal, 16(6), 511-527. https://doi.org/10.1002/sam.11636
Vancouver
Jang M, Park S, Carriquiry A. A finely tuned deep transfer learning algorithm to compare outsole images. Statistical Analysis and Data Mining: The ASA Data Science Journal. 2023;16(6):511-527. doi:10.1002/sam.11636
BibTeX
@article{Jang2023,
author = {Jang, Moonsoo and Park, Soyoung and Carriquiry, Alicia},
title = {A finely tuned deep transfer learning algorithm to compare outsole images},
journal = {Statistical Analysis and Data Mining: The ASA Data Science Journal},
year = {2023},
volume = {16},
number = {6},
pages = {511--527},
doi = {10.1002/sam.11636}
}
EUVIMED