LLM‐based Approach to Automatically Establish Traceability between Requirements and MBSE
INCOSE International Symposium · 2024-07 · 34 (1) · 2542-2560
DOI: 10.1002/iis2.13285 ↗Kurz gefasst
Fachartikel in der Zeitschrift INCOSE International Symposium, online erschienen am 07.09.2024. Verfasst von Maria Bonner und 3 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 37 Literaturangaben.
Abstract (Originalsprache)
Tracing requirements specification to design and implementation is an essential part of safety standards, as it allows to ensure that safety goals are met throughout the development process. Manual tracing numerous artifacts produced throughout the development process is error‐prone and takes much time. To address these problems, we proposed a tool (Bonner, M.; Zeller, M.; Schulz, G.; Beyer, D.; Olteanu, M., 2023), which allows to establish links between requirements and Model‐Based Systems Engineering (MBSE) in a semi‐automatic way. The underlying algorithms of our tool are embedding similarity computation and classification approaches based on Large Language Models (LLMs). To assess the performance of underlying algorithm we propose an evaluation, where we compare the recall, the precision, and the F 2 score of different approaches applied to our datasets. The goal of our evaluation is to understand how well LLMs perform in automatically generating trace links on different datasets. Our evaluation shows that it is worth to invest time in preprocessing the data and fine‐tuning the LLMs to achieve the better recommendations for engineers, which improves the traceability process.
Zitieren
APA
Bonner, M., Zeller, M., Schulz, G., & Savu, A. (2024). LLM‐based Approach to Automatically Establish Traceability between Requirements and MBSE. INCOSE International Symposium, 34(1), 2542-2560. https://doi.org/10.1002/iis2.13285
Vancouver
Bonner M, Zeller M, Schulz G, Savu A. LLM‐based Approach to Automatically Establish Traceability between Requirements and MBSE. INCOSE International Symposium. 2024;34(1):2542-2560. doi:10.1002/iis2.13285
BibTeX
@article{Bonner2024,
author = {Bonner, Maria and Zeller, Marc and Schulz, Gabor and Savu, Ana},
title = {LLM‐based Approach to Automatically Establish Traceability between Requirements and MBSE},
journal = {INCOSE International Symposium},
year = {2024},
volume = {34},
number = {1},
pages = {2542--2560},
doi = {10.1002/iis2.13285}
}
EUVIMED