EUVIMEDEUVIMED entdecken
Crossref

Evaluation of the Capability of Generative AI to Interpret and Provide Guidance on the Application of the ISO/IEC 17025 Standard

Diego Uribe

The International Journal of Conformity Assessment · 2025

DOI: 10.55459/ijca/v4i1/du ↗

Kurz gefasst

Fachartikel in der Zeitschrift The International Journal of Conformity Assessment, 2025. Verfasst von Diego Uribe.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study evaluates the ability of generative artificial intelligence models to interpret and provide guidance on the ISO/IEC 17025 standard, with a focus on L-Squad, a customized ChatGPT model. Through a 40-question exam assessing literal, inferential, and criterial comprehension—evaluating how well models can justify or reason through decisions based on standards—the performance of four AI tools (Meta AI, ChatGPT 4.0 Free, ChatGPT o1, and L-Squad) was compared using the consensus of a panel of experts in laboratory accreditation as a reference. The results showed that L-Squad achieved the highest overall score, excelling in criterial comprehension due to its customized configuration and reinforcement learning with human feedback (RLHF). However, all models exhibited strong literal and inferential understanding, with a 77.5% agreement in responses. Despite these advancements, the findings emphasize the need for model customization and human oversight when leveraging generative AI in standardization contexts such as ISO/IEC 17025. This research underscores both the potential and the limitations of generative AI to support the application of technical standards.

Zitieren

APA

Uribe, D. (2025). Evaluation of the Capability of Generative AI to Interpret and Provide Guidance on the Application of the ISO/IEC 17025 Standard. The International Journal of Conformity Assessment. https://doi.org/10.55459/ijca/v4i1/du

Vancouver

Uribe D. Evaluation of the Capability of Generative AI to Interpret and Provide Guidance on the Application of the ISO/IEC 17025 Standard. The International Journal of Conformity Assessment. 2025. doi:10.55459/ijca/v4i1/du

BibTeX
@article{Uribe2025,
  author = {Uribe, Diego},
  title = {Evaluation of the Capability of Generative AI to Interpret and Provide Guidance on the Application of the ISO/IEC 17025 Standard},
  journal = {The International Journal of Conformity Assessment},
  year = {2025},
  doi = {10.55459/ijca/v4i1/du}
}
Kostenlos starten →