EUVIMEDEUVIMED entdecken
Crossref

Deep Neural Networks in Natural Language Processing for Classifying Requirements by Origin and Functionality: An Application of BERT in System Requirements

Jesse Mullis, Cheng Chen, Beshoy Morkos, Scott Ferguson

Journal of Mechanical Design · 01.04.2024 · 146 (4)

DOI: 10.1115/1.4063764 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Mechanical Design, online erschienen am 13.11.2023. Verfasst von Jesse Mullis und 3 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 62 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Given the foundational role of system requirements in design projects, designers can benefit from classifying, comparing, and observing connections between requirements. Manually undertaking these processes, however, can be laborious and time-consuming. Previous studies have employed Bidirectional Encoder Representations from Transformers (BERT), a state-of-the-art natural language processing (NLP) deep neural network model, to automatically analyze written requirements. Yet, it remains unclear whether BERT can sufficiently capture the nuances that differentiate requirements between and within design documents. This work evaluates BERT’s performance on two requirement classification tasks (one inter- document and one intra-document) executed on a corpus of 1,303 requirements sourced from five system design projects. First, in the “parent document classification” task, a BERT model is fine-tuned to classify requirements according to their originating project. A separate BERT model is then fine-tuned on a “functional classification” task where each requirement is classified as either functional or nonfunctional. Our results also include a comparison with a baseline model, Word2Vec, and demonstrate that our model achieves higher classification accuracy. When evaluated on test sets, the former model receives a Matthews correlation coefficient (MCC) of 0.95, while the latter receives an MCC of 0.82, indicating BERT’s ability to reliably distinguish requirements. This work then explores the application of BERT’s representations, known as embeddings, to identify similar requirements and predict requirement change.

Zitieren

APA

Mullis, J., Chen, C., Morkos, B., & Ferguson, S. (2024). Deep Neural Networks in Natural Language Processing for Classifying Requirements by Origin and Functionality: An Application of BERT in System Requirements. Journal of Mechanical Design, 146(4). https://doi.org/10.1115/1.4063764

Vancouver

Mullis J, Chen C, Morkos B, Ferguson S. Deep Neural Networks in Natural Language Processing for Classifying Requirements by Origin and Functionality: An Application of BERT in System Requirements. Journal of Mechanical Design. 2024;146(4). doi:10.1115/1.4063764

BibTeX
@article{Mullis2024,
  author = {Mullis, Jesse and Chen, Cheng and Morkos, Beshoy and Ferguson, Scott},
  title = {Deep Neural Networks in Natural Language Processing for Classifying Requirements by Origin and Functionality: An Application of BERT in System Requirements},
  journal = {Journal of Mechanical Design},
  year = {2024},
  volume = {146},
  number = {4},
  doi = {10.1115/1.4063764}
}
Kostenlos starten →