EUVIMEDEUVIMED entdecken
Crossref

An artificial intelligence‐based dental semantic search engine as a reliable tool for dental students and educators

Krishna Prakash iD, Ram Prakash iD

Journal of Dental Education · 2024-09 · 88 (9) · 1257-1266

DOI: 10.1002/jdd.13560 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Dental Education, online erschienen am 07.05.2024. Verfasst von Krishna Prakash und 1 weiteren Autor:innen. Beteiligte Einrichtung: Anil Neerukonda Institute of Dental Sciences, Visakhapatnam, Andhra Pradesh, India. Hauptthemen laut MEDLINE: Education, Dental, Students, Dental, Artificial Intelligence, Semantics. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 32 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose/objectives This study proposes the utilization of a Natural Language Processing tool to create a semantic search engine for dental education while addressing the increasing concerns of accuracy, bias, and hallucination in outputs generated by AI tools. The paper focuses on developing and evaluating DentQA, a specialized question‐answering tool that makes it easy for students to seek information to access information located in handouts or study material distributed by an institution.

Methods

DentQA is structured upon the GPT3.5 language model, utilizing prompt engineering to extract information from external dental documents that experts have verified. Evaluation involves non‐human metrics (BLEU scores) and human metrics for the tool's performance, relevance, accuracy, and functionality.

Results

Non‐human metrics confirm DentQA's linguistic proficiency, achieving a Unigram BLEU score of 0.85. Human metrics reveal DentQA's superiority over GPT3.5 in terms of accuracy ( p = 0.00004) and absence of hallucination ( p = 0.026). Additional metrics confirmed consistent performance across different question types ( X 2 (4, N = 200) = 13.0378, p = 0.012). User satisfaction and performance metrics support DentQA's usability and effectiveness, with a response time of 3.5 s and over 70% satisfaction across all evaluated parameters.

Conclusions

The study advocates using a semantic search engine in dental education, mitigating concerns of misinformation and hallucination. By outlining the workflow and the utilization of open‐source tools and methods, the study encourages the utilization of similar tools for dental education while underscoring the importance of customizing AI models for dentistry. Further optimizations, testing, and utilization of recent advances can contribute to dental education significantly.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Education, DentalStudents, DentalArtificial IntelligenceSemanticsSearch EngineHumansNatural Language ProcessingFaculty, Dental

Stichwörter der Autor:innen

artificial intelligenceconversational agentdentQAdentaleducationnatural language processingsearch engine

Autor:innen und Institutionen

  • Anil Neerukonda Institute of Dental Sciences, Visakhapatnam, Andhra Pradesh, India.

ORCID-Profile: Krishna Prakash, Ram Prakash

Zitieren

APA

Prakash, K., & Prakash, R. (2024). An artificial intelligence‐based dental semantic search engine as a reliable tool for dental students and educators. Journal of Dental Education, 88(9), 1257-1266. https://doi.org/10.1002/jdd.13560

Vancouver

Prakash K, Prakash R. An artificial intelligence‐based dental semantic search engine as a reliable tool for dental students and educators. Journal of Dental Education. 2024;88(9):1257-1266. doi:10.1002/jdd.13560

BibTeX
@article{Prakash2024,
  author = {Prakash, Krishna and Prakash, Ram},
  title = {An artificial intelligence‐based dental semantic search engine as a reliable tool for dental students and educators},
  journal = {Journal of Dental Education},
  year = {2024},
  volume = {88},
  number = {9},
  pages = {1257--1266},
  doi = {10.1002/jdd.13560}
}
Kostenlos starten →