Attention-Enhanced Bi-LSTM Ensembles with Frozen ESM-2 Embeddings Achieve Competitive Performance in Protein Subcellular Localization
International Journal of Life Sciences and Biotechnology · 17.08.2026 · 9 (2) · 90-105
DOI: 10.38001/ijlsb.1882985 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Life Sciences and Biotechnology, online erschienen am 17.08.2026. Verfasst von Johaimen Omar. Die Arbeit nennt 48 Literaturangaben. Gefördert von: Kastamonu University, Türkiye; Mindanao State University - Main Campus Marawi City, Philippines.
Abstract (Originalsprache)
Predicting protein subcellular locations computationally is crucial for analyzing large protein datasets. A key issue is that similar sequences in training and test sets artificially inflate accuracy estimates. This study investigates whether Protein Language Model (PLM) features alone can achieve strong predictions using simple classifiers instead of complex architectures. We developed a streamlined deep learning framework combining pre-trained ESM-2 embeddings with an attention-enhanced Bi-LSTM network, deployed as a 3-fold ensemble with soft voting. Training used eukaryotic sequences with ≤40% similarity to ensure rigorous evaluation. The model achieved 86.81% accuracy (MCC = 0.825) on test data—a +22.27% improvement over an SVM baseline (64.54%, MCC = 0.530). On 86 newly released 2024 proteins, the system reached 88.37% accuracy (MCC = 0.827), surpassing DeepLoc 2.1 (80.23%, MCC = 0.714, p=0.007) and MULocDeep (77.91%, MCC = 0.682, p=0.019). However, the small validation set (N=86) and limited representation in categories like Mitochondrion (N=5) require cautious interpretation. The method only handles single-location assignments across four compartments, excluding multi-location proteins. Attention weight analysis shows the model identifies biologically relevant signals, including C-terminal membrane regions and N-terminal mitochondrial sequences, confirming that ESM-2 embeddings enable effective performance with simplified architectures.
Förderung
- Kastamonu University, Türkiye; Mindanao State University - Main Campus Marawi City, Philippines
Zitieren
APA
Omar, J. (2026). Attention-Enhanced Bi-LSTM Ensembles with Frozen ESM-2 Embeddings Achieve Competitive Performance in Protein Subcellular Localization. International Journal of Life Sciences and Biotechnology, 9(2), 90-105. https://doi.org/10.38001/ijlsb.1882985
Vancouver
Omar J. Attention-Enhanced Bi-LSTM Ensembles with Frozen ESM-2 Embeddings Achieve Competitive Performance in Protein Subcellular Localization. International Journal of Life Sciences and Biotechnology. 2026;9(2):90-105. doi:10.38001/ijlsb.1882985
BibTeX
@article{Omar2026,
author = {Omar, Johaimen},
title = {Attention-Enhanced Bi-LSTM Ensembles with Frozen ESM-2 Embeddings Achieve Competitive Performance in Protein Subcellular Localization},
journal = {International Journal of Life Sciences and Biotechnology},
year = {2026},
volume = {9},
number = {2},
pages = {90--105},
doi = {10.38001/ijlsb.1882985}
}
EUVIMED