Evaluation of the Capability of Generative AI to Interpret and Provide Guidance on the Application of the ISO/IEC 17025 Standard
The International Journal of Conformity Assessment · 2025
DOI: 10.55459/ijca/v4i1/du ↗Kurz gefasst
Fachartikel in der Zeitschrift The International Journal of Conformity Assessment, 2025. Verfasst von Diego Uribe.
Abstract (Originalsprache)
This study evaluates the ability of generative artificial intelligence models to interpret and provide guidance on the ISO/IEC 17025 standard, with a focus on L-Squad, a customized ChatGPT model. Through a 40-question exam assessing literal, inferential, and criterial comprehension—evaluating how well models can justify or reason through decisions based on standards—the performance of four AI tools (Meta AI, ChatGPT 4.0 Free, ChatGPT o1, and L-Squad) was compared using the consensus of a panel of experts in laboratory accreditation as a reference. The results showed that L-Squad achieved the highest overall score, excelling in criterial comprehension due to its customized configuration and reinforcement learning with human feedback (RLHF). However, all models exhibited strong literal and inferential understanding, with a 77.5% agreement in responses. Despite these advancements, the findings emphasize the need for model customization and human oversight when leveraging generative AI in standardization contexts such as ISO/IEC 17025. This research underscores both the potential and the limitations of generative AI to support the application of technical standards.
Zitieren
APA
Uribe, D. (2025). Evaluation of the Capability of Generative AI to Interpret and Provide Guidance on the Application of the ISO/IEC 17025 Standard. The International Journal of Conformity Assessment. https://doi.org/10.55459/ijca/v4i1/du
Vancouver
Uribe D. Evaluation of the Capability of Generative AI to Interpret and Provide Guidance on the Application of the ISO/IEC 17025 Standard. The International Journal of Conformity Assessment. 2025. doi:10.55459/ijca/v4i1/du
BibTeX
@article{Uribe2025,
author = {Uribe, Diego},
title = {Evaluation of the Capability of Generative AI to Interpret and Provide Guidance on the Application of the ISO/IEC 17025 Standard},
journal = {The International Journal of Conformity Assessment},
year = {2025},
doi = {10.55459/ijca/v4i1/du}
}
EUVIMED