PDF herunterladen
CC BY 4.0 · Eur J Dent
DOI: 10.1055/s-0045-1808254
Original Article

Comparing ChatGPT and Dental Students' Performance in an Introduction to Dental Anatomy Examination: A Cross-Sectional Study

Rizwan Ullah
1   Department of Oral Biology, Sindh Institute of Oral Health Sciences, Jinnah Sindh Medical University, Karachi, Pakistan
,
Muhammad Saad Shaikh 
1   Department of Oral Biology, Sindh Institute of Oral Health Sciences, Jinnah Sindh Medical University, Karachi, Pakistan
,
Nazish Shahani
1   Department of Oral Biology, Sindh Institute of Oral Health Sciences, Jinnah Sindh Medical University, Karachi, Pakistan
,
Mohid Abrar Lone
2   Department of Oral Pathology, Sindh Institute of Oral Health Sciences, Jinnah Sindh Medical University, Karachi, Pakistan
,
Muhammad Amber Fareed 
3   Clinical Sciences Department, College of Dentistry, Ajman University, Ajman, United Arab Emirates
4   Centre of Medical and Bio-allied Health Sciences Research, Ajman University, Ajman, United Arab Emirates
,
Muhammad Sohail Zafar 
3   Clinical Sciences Department, College of Dentistry, Ajman University, Ajman, United Arab Emirates
4   Centre of Medical and Bio-allied Health Sciences Research, Ajman University, Ajman, United Arab Emirates
5   School of Dentistry, University of Jordan, Amman, Jordan
› Institutsangaben Funding None.
› Weitere Informationen
Auch verfügbar auf
   Lizenzen und Reprints

Abstract

Objectives

This article compares the knowledge and interpretation ability of Chat Generative Pre-Trained Transformer (ChatGPT), with undergraduate dental students by administering a dental anatomy multiple-choice question-based examination.

Materials and Methods

This analytical cross-sectional study determined ChatGPT's justification for each response to evaluate its suitability as an e-learning tool. The frequency and percentage of students and ChatGPT were calculated to obtain the correct answers for a multiple-choice examination.

Statistical Analysis

The data analysis was performed through Statistical Package for Social Sciences (SPSS) by IBM (Version 20) and Microsoft Excel by Microsoft Corporation. The frequency and percentage of students and the ChatGPT were calculated for the correct answers. The p-value of the Shapiro–Wilk test was 0.001, therefore, the Kolmogorov test was applied to check the hypothesis for the distribution of the average ChatGPT explanation score given by the experts.

Results

The results revealed that students performed better in the introductory dental anatomy examination. The average score of students was 74.28%, while that of ChatGPT was 60%. A good agreement was observed between the experts regarding the grading of the explanation.

Conclusion

ChatGPT possesses a foundational understanding of basic dental anatomy, sufficient to achieve a passing grade on an undergraduate examination, its performance exhibits limitations in accuracy and reliability, therefore, it cannot be recommended as a sole learning resource.

Keywords

dental anatomy - artificial intelligence - dental education - ChatGPT - tooth morphology

Consent for Publication

None.


Data Availability Statement

The data sets used and/or analyzed during the current study are available from the corresponding author on reasonable request.


Authors' Contributions

Conceptualization: R.U. and M.S.S. Writing – original draft: R.U. and M.S.S. Data curation, methodology, and writing – original draft: M.S.S., M.A.L., and N.S. Writing – review and editing: M.A.F. and M.S.Z. Supervision: M.S.Z.


Supplementary Material



Publikationsverlauf

Artikel online veröffentlicht:
13. Mai 2025

© 2025. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution License, permitting unrestricted use, distribution, and reproduction so long as the original work is properly cited. (https://creativecommons.org/licenses/by/4.0/)

Thieme Medical and Scientific Publishers Pvt. Ltd.
A-12, 2nd Floor, Sector 2, Noida-201301 UP, India

 

  • References

  • 1 Ullah R, Husain S, Zafar MS. Pandemic coerces the use of online resources for dental education. J Taibah Univ Med Sci 2022; 17 (06) 1083-1086
    PubMedSuche in Google Scholar
  • 2 Yu-Fong Chang J, Wang LH, Lin TC, Cheng FC, Chiang CP. Comparison of learning effectiveness between physical classroom and online learning for dental education during the COVID-19 pandemic. J Dent Sci 2021; 16 (04) 1281-1289
    PubMedSuche in Google Scholar
  • 3 Otifi HM, Hassan HM, Andarawi MO. Evaluation of the effect of COVID-19 mandated shift to virtual teaching on medical students' performance at King Khalid University, Abha. J Taibah Univ Med Sci 2023; 18 (02) 331-336
    PubMedSuche in Google Scholar
  • 4 Hunck S, Engelhard K, Mildenberger P, Kurz S. Chances and challenges of increasing digitalization of teaching in the discipline anesthesiology from the perspective of students [in German]. Anaesthesiologie 2022; 71 (09) 689-696
    PubMedSuche in Google Scholar
  • 5 Thurzo A, Strunga M, Urban R, Surovková J, Afrashtehfar KI. Impact of artificial intelligence on dental education: a review and guide for curriculum update. Educ Sci 2023; 13 (02) 1-14
    Suche in Google Scholar
  • 6 Sarfaraz S, Khurshid Z, Zafar MS. Use of artificial intelligence in medical education: a strength or an infirmity. J Taibah Univ Med Sci 2023; 18 (06) 1553-1554
    PubMedSuche in Google Scholar
  • 7 Mahrous A, Botsko DL, Elgreatly A, Tsujimoto A, Qian F, Schneider GB. The use of artificial intelligence and game-based learning in removable partial denture design: a comparative study. J Dent Educ 2023; 87 (08) 1188-1199
    PubMedSuche in Google Scholar
  • 8 Johnson M, Ribeiro AP, Drew TM, Pereira PNR, Generative AI. Generative AI use in dental education: efficient exam item writing. J Dent Educ 2023; 87 (Suppl. 03) 1865-1866
    PubMedSuche in Google Scholar
  • 9 Mladenovic R, Milosavljevic M, Stanisic D, Vasovic M. Importance of artificial intelligence in the analysis of children's CBCT imaging by dental students. J Dent Educ 2023; 87 (Suppl. 01) 914-916
    PubMedSuche in Google Scholar
  • 10 Mhlanga D. Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. In: Mhlanga D. ed FinTech and Artificial Intelligence for Sustainable Development: The Role of Smart Technologies in Achieving Development Goals. Cham, Switzerland: Springer Nature; 2023: 387-409
    Suche in Google Scholar
  • 11 Susnjak T. ChatGPT: the end of online exam integrity?. arXiv preprint arXiv:221209292; 2022
    Suche in Google Scholar
  • 12 Bang Y, Cahyawijaya S, Lee N. et al. A multitask, multilingual, multimodal evaluation of chatgpt on reasoning, hallucination, and interactivity. arXiv preprint arXiv:230204023; 2023
    Suche in Google Scholar
  • 13 Qadir J. Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education. IEEE global engineering education conference (EDUCON). 2023; 1–9
  • 14 Khan RA, Jawaid M, Khan AR, Sajjad M. ChatGPT - reshaping medical education and clinical management. Pak J Med Sci 2023; 39 (02) 605-607
    CrossrefPubMedSuche in Google Scholar
  • 15 Open AI. . Introducing ChatGPT. OpenAI. Accessed February 28, 2023 at: https://openai.com/blog/chatgpt
  • 16 García-Peñalvo FJ. . The perception of Artificial Intelligence in educational contexts after the launch of ChatGPT: disruption or panic? [La percepción de la Inteligencia Artificial en contextos educativos tras el lanzamiento de ChatGPT: disrupción o pánico]. Education in the Knowledge Society (EKS) 2023;24:e31279
  • 17 Gilson A, Safranek C, Huang T. et al. How does ChatGPT perform on the medical licensing exams? The implications of large language models for medical education and knowledge assessment. medRxiv 2022:212
  • 18 Wang X, Gong Z, Wang G. et al. Chatgpt performs on the Chinese National Medical Licensing Examination. J Med Syst 2023; 47 (01) 86
    PubMedSuche in Google Scholar
  • 19 Kortemeyer G. Could an Artificial-Intelligence agent pass an introductory physics course?. arXiv preprint arXiv:230112127; 2023
    Suche in Google Scholar
  • 20 Zhai X. ChatGPT for next generation science learning. SSRN 2023; 4331313: 42-46
    Suche in Google Scholar
  • 21 Khalil M, Er E. Will ChatGPT get you caught? Rethinking of Plagiarism Detection. arXiv preprint arXiv:230204335; 2023
    Suche in Google Scholar
  • 22 Ventayen RJM. OpenAI ChatGPT Generated Results: Similarity Index of Artificial Intelligence-Based Contents. In: International Conference on Soft Computing for Security Applications. Singapore: Springer Nature, 2023;215–226
  • 23 Cotton DR, Cotton PA, Shipway JR. Chatting and cheating. Ensuring academic integrity in the era of ChatGPT. . Innov Educ Teach Int 2024;61(2)
  • 24 Bishop L. A Computer Wrote this Paper: What ChatGPT Means for Education, Research, and Writing. Research, and Writing (January 26, 2023). 2023 . doi: 10.2139/ssrn.4338981
  • 25 King MR. chatGPT. A conversation on artificial intelligence, chatbots, and plagiarism in higher education. Cell Mol Bioeng 2023; 16 (01) 1-2
    PubMedSuche in Google Scholar
  • 26 Danesh A, Pazouki H, Danesh K, Danesh F, Danesh A. The performance of artificial intelligence language models in board-style dental knowledge assessment: a preliminary study on ChatGPT. J Am Dent Assoc 2023; 154 (11) 970-974
    PubMedSuche in Google Scholar
  • 27 Danesh A, Pazouki H, Danesh F, Danesh A, Vardar-Sengul S. Artificial intelligence in dental education: ChatGPT's performance on the periodontic in-service examination. J Periodontol 2024; 95 (07) 682-687
    PubMedSuche in Google Scholar
  • 28 Sabri H, Saleh MH, Hazrati P. et al. Performance of three artificial intelligence (AI)-based large language models in standardized testing; implications for AI-assisted dental education. . J Periodontal Res 2024
  • 29 von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. STROBE Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. Int J Surg 2014; 12 (12) 1495-1499
    CrossrefPubMedSuche in Google Scholar
  • 30 Huh S. Are ChatGPT's knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study. J Educ Eval Health Prof 2023; 20 (01) 1
    PubMedSuche in Google Scholar
  • 31 Ali K, Barhom N, Tamimi F, Duggal M. ChatGPT-A double-edged sword for healthcare education? Implications for assessments of dental students. Eur J Dent Educ 2024; 28 (01) 206-211
    PubMedSuche in Google Scholar
  • 32 Atlas S. ChatGPT for higher education and professional development: A guide to conversational AI. University of Rhode Island; 2023. https://digitalcommons.uri.edu/cba_facpubs/548
  • 33 Suchman K, Garg S, Trindade AJ. Chat Generative Pretrained Transformer fails the multiple-choice American College of Gastroenterology self-assessment test. Am J Gastroenterol 2022; 10: 14309
    Suche in Google Scholar
  • 34 Kováč P, Jackuliak P, Bražinová A. et al. artificial intelligence-driven facial image analysis for the early detection of rare diseases: legal, ethical, forensic, and cybersecurity considerations. AI 2024; 5 (03) 990-1010
    Suche in Google Scholar
  • 35 Fuchs A, Trachsel T, Weiger R, Eggmann F. ChatGPT's performance in dentistry and allergy immunology assessments: a comparative study. Swiss Dent J 2023; 134 (02) 1-17
    PubMedSuche in Google Scholar
  • 36 Bagde H, Dhopte A, Alam MK, Basri R. A systematic review and meta-analysis on ChatGPT and its utilization in medical and dental research. Heliyon 2023; 9 (12) e23050
    PubMedSuche in Google Scholar
  • 37 Huang H, Zheng O, Wang D. et al. ChatGPT for shaping the future of dentistry: the potential of multi-modal large language model. Int J Oral Sci 2023; 15 (01) 29
    PubMedSuche in Google Scholar
  • 38 Jin HK, Lee HE, Kim E. Performance of ChatGPT-3.5 and GPT-4 in national licensing examinations for medicine, pharmacy, dentistry, and nursing: a systematic review and meta-analysis. BMC Med Educ 2024; 24 (01) 1013
    PubMedSuche in Google Scholar
  • 39 Temiz M, Güzel C. Assessing the performance of ChatGPT on dentistry specialization exam questions: a comparative study with DUS examinees. Med Rec 2025; 7 (01) 162-166
    Suche in Google Scholar
  • 40 Buchmann E, Thor A. Online Exams in the Era of ChatGPT. In: Fachtagung Bildungstechnologien (DELFI). Gesellschaft für Informatik eV 2023;79–84
  • 41 Kim CS, Samaniego CS, Sousa Melo SL, Brachvogel WA, Baskaran K, Rulli D. Artificial intelligence (AI) in dental curricula: ethics and responsible integration. J Dent Educ 2023; 87 (11) 1570-1573
    PubMedSuche in Google Scholar