EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Comparative Study of Automated Approaches for Detecting Subjectivity and Unverifiability in Natural Language Software Requirements

Muhammad Arsalan Iltaf, Aamer Nadeem

International Journal of Innovations in Science and Technology · 28.04.2026 · 75

DOI: 10.33411/ijist/1828 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Innovations in Science and Technology, online erschienen am 28.04.2026. Verfasst von Muhammad Arsalan Iltaf und 1 weiteren Autor:innen. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Natural language software requirements are prone to subjectivity and unverifiability, which reduces clarity and testability. This study provides a controlled comparative evaluation of four automated detection approaches: rule-based lexicons, classical machine-learning models with TF-IDF features, a fine-tuned DistilBERT transformer, and a feature-level hybrid model that concatenates rule-based linguistic indicators with DistilBERT contextual embeddings on the same manually annotated dataset of 985 requirements, including 259 subjective and 726 objective items, and 165 unverifiable and 820 verifiable items. All models used identical preprocessing, an 80:20 stratified train-test split, and the same evaluation metrics. The rule-based approach achieved a precision of 0.67 and a recall of 0.04 for subjectivity and zero recall for unverifiability. Classical ML models reached F1-scores ranging from 0.47 to 0.58 (positive class). DistilBERT obtained weighted F1-scores of 0.74 (subjectivity) and 0.86 (unverifiability). The feature-level hybrid model improved subjectivity detection to a weighted F1-score of 0.79 while matching DistilBERT at 0.86 for unverifiability. These results demonstrate that combining explicit linguistic cues with contextual embeddings improves detection performance under class imbalance.

Zitieren

APA

Iltaf, M. A., & Nadeem, A. (2026). A Comparative Study of Automated Approaches for Detecting Subjectivity and Unverifiability in Natural Language Software Requirements. International Journal of Innovations in Science and Technology, 75. https://doi.org/10.33411/ijist/1828

Vancouver

Iltaf MA, Nadeem A. A Comparative Study of Automated Approaches for Detecting Subjectivity and Unverifiability in Natural Language Software Requirements. International Journal of Innovations in Science and Technology. 2026:75. doi:10.33411/ijist/1828

BibTeX
@article{Iltaf2026,
  author = {Iltaf, Muhammad Arsalan and Nadeem, Aamer},
  title = {A Comparative Study of Automated Approaches for Detecting Subjectivity and Unverifiability in Natural Language Software Requirements},
  journal = {International Journal of Innovations in Science and Technology},
  year = {2026},
  pages = {75},
  doi = {10.33411/ijist/1828}
}
Kostenlos starten →