EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hybrid Ensemble of Large Language Models and Fractional Derivative Features for Domain-Specific Engineering Sentiment Analysis

Abdul Karim, Evi Triandini, Seoyeong Lee, In cheol Jeong

Applied Sciences · 27.04.2026 · 16 (9) · 4266

DOI: 10.3390/app16094266 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 27.04.2026. Verfasst von Abdul Karim und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation of Korea.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study addresses the need for applied sentiment analysis in engineering decision-support systems by presenting a hybrid framework for domain-specific engineering text. This study presents a hybrid sentiment classification framework by integrating transformer-based semantic embeddings with fractional-order feature modeling. The proposed BERTLR framework combines BERT and RoBERTa representations with Grünwald–Letnikov fractional derivative–enhanced TF-IDF features and logistic regression within a unified soft-voting architecture. Unlike conventional ensemble sentiment models that merely aggregate embeddings and handcrafted features, the proposed method introduces fractional-order feature transformation to capture non-local dependency patterns and memory-aware lexical variations that are often overlooked in technical review text. This design provides a structured fusion of contextual semantic information and fractional statistical representations, supported by SHAP-based explainability and ablation analysis. Experiments conducted on six real-world engineering application domains show consistent improvements over conventional TF-IDF models, LSTM baselines, and non-fractional transformer variants. The framework achieves up to 91% accuracy, together with strong precision, recall, and F1-score performance. These results demonstrate that fractional-order feature augmentation can provide a meaningful complementary signal to transformer embeddings, offering an interpretable and effective sentiment analysis solution for engineering and industrial decision-support applications.

Förderung

  • National Research Foundation of Korea

Zitieren

APA

Karim, A., Triandini, E., Lee, S., & Jeong, I. C. (2026). Hybrid Ensemble of Large Language Models and Fractional Derivative Features for Domain-Specific Engineering Sentiment Analysis. Applied Sciences, 16(9), 4266. https://doi.org/10.3390/app16094266

Vancouver

Karim A, Triandini E, Lee S, Jeong IC. Hybrid Ensemble of Large Language Models and Fractional Derivative Features for Domain-Specific Engineering Sentiment Analysis. Applied Sciences. 2026;16(9):4266. doi:10.3390/app16094266

BibTeX
@article{Karim2026,
  author = {Karim, Abdul and Triandini, Evi and Lee, Seoyeong and Jeong, In cheol},
  title = {Hybrid Ensemble of Large Language Models and Fractional Derivative Features for Domain-Specific Engineering Sentiment Analysis},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {9},
  pages = {4266},
  doi = {10.3390/app16094266}
}
Kostenlos starten →