Barw Medical Journal

Original Articles Barw Medical Journal. 2023;2(1)

Comparative Analysis of ChatGPT and Human Decision-Making in Thyroid and Neck Swellings: A Case-Based Study

, , , , , , , , , , , , , , , ,

Zardasht Mahmud Ahamed

  • 1Hospital of Treatment Victims Chemical Weapon in Halabja, Halabja, Kurdistan, Iraq

2 articles in this journal

Hardi Mohammed Dhahir

  • 2Shahid Peshraw Hospital, Chamchamal, Sulaimani, Kurdistan, Iraq.

Miran Mawlood Mohammed

  • 3Shar Hospital, Sulaimani, Kurdistan, Iraq.

Rebaz Haji Ali

  • 4Hiwa Cancer Hospital, Sulaimani Directorate of Health, Kurdistan, Iraq.

3 articles in this journal

Shko H. Hassan

  • 5Smart Health Tower, Madam Mitterrand Street, Sulaimani, Kurdistan, Iraq

11 articles in this journal

Aso S. Muhialdeen

  • 5Smart Health Tower, Madam Mitterrand Street, Sulaimani, Kurdistan, Iraq

11 articles in this journal

Yadgar Abdulhameed Saeed

  • 6Baxshin Hospital, Malik Mahmud Street, Sulaimani, Kurdistan, Iraq.

Mariwan L. Fatah

  • 7College of Medicine, University of Sulaimani, Madam Mitterrand Street, Sulaimani, Kurdistan, Iraq

3 articles in this journal

Aras J. Qaradakhy

  • 8Department of Radiology, Shorsh Teaching Hospital, Sulaimani, Kurdistan, Iraq.

12 articles in this journal

Rawa M. Ali

  • 5Smart Health Tower, Madam Mitterrand Street, Sulaimani, Kurdistan, Iraq

13 articles in this journal

Shaho F. Ahmed

  • 5Smart Health Tower, Madam Mitterrand Street, Sulaimani, Kurdistan, Iraq

10 articles in this journal

Ari M. Abdullah

  • 9Sulaimani Teaching Hospital, Sulaimani, Kurdistan, Iraq

18 articles in this journal

Hawbash M. Rahim

  • 10Department of Medical Laboratory Science, College of Health Sciences, University of Human Development, Kurdistan Region, Sulaimani, Iraq.

17 articles in this journal

Berun A. Abdalla

  • 11Kscien Organization for Scientific Research (Middle East office), Hamid Str, Azadi Mall, Sulaimani, Kurdstan, Iraq

61 articles in this journal

Abdulwahid M. Salih

  • 7College of Medicine, University of Sulaimani, Madam Mitterrand Street, Sulaimani, Kurdistan, Iraq

44 articles in this journal

Shvan H. Mohammed

  • 11Kscien Organization for Scientific Research (Middle East office), Hamid Str, Azadi Mall, Sulaimani, Kurdstan, Iraq

39 articles in this journal

Fahmi H. kakamad

  • 7College of Medicine, University of Sulaimani, Madam Mitterrand Street, Sulaimani, Kurdistan, Iraq

Corresponding author

63 articles in this journal

  • 1Hospital of Treatment Victims Chemical Weapon in Halabja, Halabja, Kurdistan, Iraq
  • 2Shahid Peshraw Hospital, Chamchamal, Sulaimani, Kurdistan, Iraq.
  • 3Shar Hospital, Sulaimani, Kurdistan, Iraq.
  • 4Hiwa Cancer Hospital, Sulaimani Directorate of Health, Kurdistan, Iraq.
  • 5Smart Health Tower, Madam Mitterrand Street, Sulaimani, Kurdistan, Iraq
  • 6Baxshin Hospital, Malik Mahmud Street, Sulaimani, Kurdistan, Iraq.
  • 7College of Medicine, University of Sulaimani, Madam Mitterrand Street, Sulaimani, Kurdistan, Iraq
  • 8Department of Radiology, Shorsh Teaching Hospital, Sulaimani, Kurdistan, Iraq.
  • 9Sulaimani Teaching Hospital, Sulaimani, Kurdistan, Iraq
  • 10Department of Medical Laboratory Science, College of Health Sciences, University of Human Development, Kurdistan Region, Sulaimani, Iraq.
  • 11Kscien Organization for Scientific Research (Middle East office), Hamid Str, Azadi Mall, Sulaimani, Kurdstan, Iraq

Corresponding author: [email protected] (Fahmi H. kakamad)

Submitted
3 Oct 2023
Published
24 Oct 2023
Reads
993
Downloads
749
Citations
3 Citations are Crossref’s count on 8 November 2026.

doi:10.58742/bmj.v1i2.43 Open access CC BY 4.0 licence (opens in a new tab)

Download PDF XML

Abstract

IntroductionThis study aimed to evaluate the performance of Chat Generative Pre-Trained Transformer (ChatGPT), an AI-powered chatbot, in providing treatment recommendations for head and neck nodules.

MethodsTen diverse cases were examined, including individuals with varying ages and conditions such as thyroid nodules and suspicious neck lesions. The decisions made by ChatGPT were compared to those of physicians. Data were collected from the Smart Health Tower on May 2, 2023.

ResultsAnalysis of the cases revealed that ChatGPT provided recommendations that aligned with physicians' decisions in seven cases. However, disparities were observed in three cases (N5, N8, N10). Discrepancies were influenced by factors such as nodule size, thyroid function, and the presence of associated symptoms.

ConclusionThe findings suggest that ChatGPT can assist healthcare professionals in formulating individualized diagnoses and treatment strategies for head and neck nodules. However, further research is needed to validate the performance of ChatGPT in larger patient populations and assess its long-term impact on patient outcomes.

Keywords ChatGPT Nodules Case-Based Approach Head Neck AI All subjects

Sections3

The full text is in the PDF of record

This article was published as a typeset PDF and XML. The abstract above is the version of record’s own summary; the complete text, its figures, its tables and its reference list are in the files below.

Citable now
Barw Medical Journal. 2023;2(1)
Where it sits
Volume 2, Issue 1

References23

  1. Amisha, Malik P, Pathania M, Rathaur VK. Overview of artificial intelligence in medicine. J Fam Med Prim care. 2019 Jul;8(7):2328–31. doi:10.4103/jfmpc.jfmpc_440_19

    10.4103/jfmpc.jfmpc_440_19CrossrefPubMedScopusGoogle Scholar

  2. Gilson A, Safranek CW, Huang T, Socrates V, Chi L, Taylor RA, et al. How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment. JMIR Med Educ. 2023 Feb;9: e45312. doi:10.2196/45312

    10.2196/45312CrossrefPubMedScopusGoogle Scholar

  3. Ayers JW, Zhu Z, Poliak A, Leas EC, Dredze M, Hogarth M, et al. Evaluating Artificial Intelligence Responses to Public Health Questions. JAMA Netw Open [Internet]. 2023 Jun 7;6(6):e2317517–e2317517. Available from: doi:10.1001/jamanetworkopen.2023.17517

    10.1001/jamanetworkopen.2023.17517CrossrefPubMedScopusGoogle Scholar

  4. ChatGPT — Release Notes | OpenAI Help Center [Internet]. [cited 2023 Jun 25]. Available from: https://help.openai.com/en/articles/6825453-chatgpt-release-notes.

    CrossrefPubMedGoogle Scholar

  5. Dave T, Athaluri SA, Singh S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations [Internet]. Vol. 6, Frontiers in Artificial Intelligence 2023. doi:10.3389/frai.2023.1169595

    10.3389/frai.2023.1169595CrossrefPubMedScopusGoogle Scholar

  6. Khan RA, Jawaid M, Khan AR, Sajjad M. ChatGPT - Reshaping medical education and clinical management. Pakistan J Med Sci. 2023;39(2):605–7. doi:10.12669/pjms.39.2.7653

    10.12669/pjms.39.2.7653CrossrefPubMedScopusGoogle Scholar

  7. Hirosawa T, Harada Y, Yokose M, Sakamoto T, Kawamura R, Shimizu T. Diagnostic Accuracy of Differential-Diagnosis Lists Generated by Generative Pretrained Transformer 3 Chatbot for Clinical Vignettes with Common Chief Complaints: A Pilot Study. Int J Environ Res Public Health. 2023 Feb;20(4). doi:10.3390/ijerph20043378

    10.3390/ijerph20043378CrossrefPubMedScopusGoogle Scholar

  8. Liao Z, Wang J, Shi Z, Lu L, Tabata H. Revolutionary Potential of ChatGPT in Constructing Intelligent Clinical Decision Support Systems. Annals of biomedical engineering. United States; 2023. doi:10.1007/s10439-023-03288-w

    10.1007/s10439-023-03288-wCrossrefPubMedScopusGoogle Scholar

  9. Lecler A, Duron L, Soyer P. Revolutionizing radiology with GPT-based models: Current applications, future possibilities and limitations of ChatGPT. Diagn Interv Imaging. 2023;104(6):269–74. doi:10.1016/j.diii.2023.02.003

    10.1016/j.diii.2023.02.003CrossrefPubMedScopusGoogle Scholar

  10. Balas M, Ing EB. Conversational AI Models for ophthalmic diagnosis: Comparison of ChatGPT and the Isabel Pro Differential Diagnosis Generator. JFO Open Ophthalmol. 2023; 1:100005. doi:10.1016/j.jfop.2023.100005

    10.1016/j.jfop.2023.100005CrossrefPubMedScopusGoogle Scholar

  11. Li W, Zhang Y, Chen F. ChatGPT in Colorectal Surgery: A Promising Tool or a Passing Fad? Ann Biomed Eng. 2023; Available from: doi:10.1007/s10439-023-03232-y.

    10.1007/s10439-023-03232-yCrossrefPubMedScopusGoogle Scholar

  12. Ma Y. The potential application of ChatGPT in gastrointestinal pathology. Gastroenterol Endosc. 2023;1(3):130–1. doi:10.1016/j.gande.2023.05.002

    10.1016/j.gande.2023.05.002CrossrefPubMedScopusGoogle Scholar

  13. Sinha RK, Deb Roy A, Kumar N, Mondal H. Applicability of ChatGPT in Assisting to Solve Higher Order Problems in Pathology. Cureus. 2023; 15(2): e35237. doi:10.7759/cureus.35237

    10.7759/cureus.35237CrossrefPubMedScopusGoogle Scholar

  14. Giannos P. Evaluating the limits of AI in medical specialisation: ChatGPT’s performance on the UK Neurology Specialty Certificate Examination. BMJ Neurol Open. 2023; 5(1): e000451. doi:10.1136/bmjno-2023-000451

    10.1136/bmjno-2023-000451CrossrefPubMedScopusGoogle Scholar

  15. Baumgartner C. The potential impact of ChatGPT in clinical and translational medicine. Clin Transl Med. 2023; 13(3): e1206. doi:10.1002/ctm2.1206

    10.1002/ctm2.1206CrossrefPubMedScopusGoogle Scholar

  16. Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nat Med. 2019;25(1):44–56. doi:10.1038/s41591-018-0300-7

    10.1038/s41591-018-0300-7CrossrefPubMedScopusGoogle Scholar

  17. Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, et al. Artificial intelligence in healthcare: past, present and future. Stroke Vasc Neurol. 2017; 2(4):230 LP – 243. doi:10.1136/svn-2017-000101

    10.1136/svn-2017-000101CrossrefPubMedScopusGoogle Scholar

  18. Mittelstadt BD, Allo P, Taddeo M, Wachter S, Floridi L. The ethics of algorithms: Mapping the debate. Big Data Soc. 2016; 3(2):2053951716679679. doi:10.1177/2053951716679679

    10.1177/2053951716679679CrossrefPubMedScopusGoogle Scholar

  19. Kung TH, Cheatham M, Medenilla A, Sillos C, De Leon L, Elepaño C, et al. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit Heal. 2023; 2(2): e0000198. doi:10.1371/journal.pdig.0000198

    10.1371/journal.pdig.0000198CrossrefPubMedScopusGoogle Scholar

  20. Hoch CC, Wollenberg B, Lüers J-C, Knoedler S, Knoedler L, Frank K, et al. ChatGPT’s quiz skills in different otolaryngology subspecialties: an analysis of 2576 single-choice and multiple-choice board certification preparation questions. Eur Arch oto-rhino-laryngology Off J Eur Fed Oto-Rhino-Laryngological Soc Affil with Ger Soc Oto-Rhino-Laryngology - Head Neck Surg. 2023. doi:10.1007/s00405-023-08051-4

    10.1007/s00405-023-08051-4CrossrefPubMedScopusGoogle Scholar

  21. Wang B, Wan Z, Li C, Zhang M, Shi Y, Miao X, et al. Identification of benign and malignant thyroid nodules based on dynamic AI ultrasound intelligent auxiliary diagnosis system. Front Endocrinol (Lausanne). 2022; 13:1018321. doi:10.3389/fendo.2022.1018321

    10.3389/fendo.2022.1018321CrossrefPubMedScopusGoogle Scholar

  22. Nguyen DT, TD, Batchuluun G, Yoon HS, Park KR. Artificial Intelligence-Based Thyroid Nodule Classification Pham Using Information from Spatial and Frequency Domains. J Clin Med. 2019; 8(11). doi:10.3390/jcm8111976

    10.3390/jcm8111976CrossrefPubMedScopusGoogle Scholar

Copyright © 2023 The Author(s)

  • Role of ChatGPT and Google Bard in the Diagnosis of Psychiatric Disorders: A Comparative Study

    Yadgar N. Abbas, Yousif M. Mahmood, Hemn A. Hassan, Dyari Qadir Hamad, Sabah Jalal Hasan, Diyar A. Omer, Suhaib H. Kakamad, Hussein M. HamaSalih and 6 more

    Introduction The incorporation of artificial intelligence (AI) in the medical decision-making matrix has captured interest across diverse medical domains. This study aimed to juxtapose the decision-making patterns of humans and artificial intelligence regarding psychiatric disorders. Methods A set of case stories…

    2023 1,266 reads 5 citations

    doi:10.58742/4vd6h741

    Full text PDF XML

  • ChatGPT Insight and Opinion Regarding the Controversies in Neurogenic Thoracic Outlet Syndrome: A Case-Based Study

    Ameer M. Salih, Nashaddin A. Mohammed, Yousif M. Mahmood, Sabah J. Hassan, Hiwa S. Namiq, Abdullah K. Ghafour, Saywan K. Asaad, Suhaib H. Kakamad and 7 more

    Introduction There are several controversies regarding thoracic outlet syndrome. This manuscript evaluates the utility of ChatGPT in providing insights into the controversies surrounding neurogenic thoracic outlet syndrome (nTOS). Methods The following questions were chatted with ChatGPT based on OpenAI's GPT-4…

    2023 1,033 reads 5 citations

    doi:10.58742/bmj.v1i2.48

    Full text PDF XML

  • Exploring Large Language Models Integration in the Histopathologic Diagnosis of Skin Diseases: A Comparative Study

    Talar Sabir Ahmed, Rawa M. Ali, Ari M. Abdullah, Hadeel A. Yasseen, Ronak S. Ahmed, Ameer M. Salih, Dilan S. Hiwa, Shvan H. Mohammed

    Introduction The exact manner in which large language models will be integrated into pathology is not yet fully comprehended. This study examines the accuracy, benefits, biases, and limitations of large language models in diagnosing dermatologic conditions within pathology. Methods A pathologist compiled 60 real…

    2025 968 reads 1 citation

    doi:10.58742/bmj.v3i3.180

    Full text PDF XML

PDF