Artificial intelligence; ChatGPT; Decision; GPT; Head neck surgery; Otolaryngology; Performance; Otorhinolaryngology; General Medicine
Abstract :
[en] [en] OBJECTIVES: To evaluate the ChatGPT-4 performance in oncological board decisions.
METHODS: Twenty medical records of patients with head and neck cancer were evaluated by ChatGPT-4 for additional examinations, management, and therapeutic approaches. The ChatGPT-4 propositions were assessed with the Artificial Intelligence Performance Instrument. The stability of ChatGPT-4 was evaluated through regenerated answers at 1-day interval.
RESULTS: ChatGPT-4 provided adequate explanations for cTNM staging in 19 cases (95%). ChatGPT-4 proposed a significant higher number of additional examinations than practitioners (72 versus 103; p = 0.001). ChatGPT-4 indications of endoscopy-biopsy, HPV research, ultrasonography, and PET-CT were consistent with the oncological board decisions. The therapeutic propositions of ChatGPT-4 were accurate in 13 cases (65%). Most additional examination and primary treatment propositions were consistent throughout regenerated response process.
CONCLUSIONS: ChatGPT-4 may be an adjunctive theoretical tool in oncological board simple decisions.
Disciplines :
Otolaryngology
Author, co-author :
Lechien, Jérome ; Université de Mons - UMONS > Faculté de Psychologie et des Sciences de l'Educatio > Service de Métrologie et Sciences du langage
Chiesa-Estomba, Carlos-Miguel; Research Committee of Young-Otolaryngologists of the International Federations of Oto-Rhino-Laryngological Societies (YO-IFOS), Paris, France ; Department of Otorhinolaryngology-Head and Neck Surgery, Hospital Universitario Donostia, San Sebastian, Spain
Baudouin, Robin; Research Committee of Young-Otolaryngologists of the International Federations of Oto-Rhino-Laryngological Societies (YO-IFOS), Paris, France ; Department of Otolaryngology-Head Neck Surgery, Foch Hospital, UFR Simone Veil, University Paris Saclay, Paris, France ; Phonetics and Phonology Laboratory (UMR 7018 CNRS, Université Sorbonne Nouvelle/Paris 3), Paris, France
Hans, Stéphane; Research Committee of Young-Otolaryngologists of the International Federations of Oto-Rhino-Laryngological Societies (YO-IFOS), Paris, France ; Department of Otolaryngology-Head Neck Surgery, Foch Hospital, UFR Simone Veil, University Paris Saclay, Paris, France ; Phonetics and Phonology Laboratory (UMR 7018 CNRS, Université Sorbonne Nouvelle/Paris 3), Paris, France
Language :
English
Title :
Accuracy of ChatGPT in head and neck oncological board decisions: preliminary findings.
Publication date :
22 November 2023
Journal title :
European Archives of Oto-Rhino-Laryngology
ISSN :
0937-4477
eISSN :
1434-4726
Publisher :
Springer Science and Business Media Deutschland GmbH, Germany
Vaira LA, Lechien JR, Abbate V, Allevi F, Audino A, Beltramini GA et al (2023) Accuracy of ChatGPT-generated information on head and neck and oromaxillofacial surgery: a multicenter collaborative analysis. Otolaryngol head neck surg. 10.1002/ohn.489 DOI: 10.1002/ohn.489
Hill-Yardin EL, Hutchinson MR, Laycock R, Spencer SJ (2023) A Chat(GPT) about the future of scientific publishing. Brain Behav Immun 110:152–154. 10.1016/j.bbi.2023.02.022 DOI: 10.1016/j.bbi.2023.02.022
Hoch CC, Wollenberg B, Lüers JC, Knoedler S, Knoedler L, Frank K, Cotofana S, Alfertshofer M (2023) ChatGPT’s quiz skills in different otolaryngology subspecialties: an analysis of 2576 single-choice and multiple-choice board certification preparation questions. Eur Arch Otorhinolaryngol. 10.1007/s00405-023-08051-4 DOI: 10.1007/s00405-023-08051-4
Chiesa-Estomba CM, Lechien JR, Vaira LA, Brunet A, Cammaroto G, Mayo-Yanez M, Sanchez-Barrueco A, Saga-Gutierrez C (2023) Exploring the potential of Chat-GPT as a supportive tool for sialendoscopy clinical decision making and patient information support. Eur Arch Otorhinolaryngol. 10.1007/s00405-023-08104-8 DOI: 10.1007/s00405-023-08104-8
Lechien JR, Maniaci A, Gengler I, Hans S, Chiesa-Estomba CM, Vaira LA (2023) Validity and reliability of an instrument evaluating the performance of intelligent chatbot: the artificial intelligence performance instrument (AIPI). Eur Arch Otorhinolaryngol. 10.1007/s00405-023-08219-y DOI: 10.1007/s00405-023-08219-y
Lechien JR, Georgescu BM, Hans S, Chiesa-Estomba CM (2023) ChatGPT performance in laryngology and head & neck surgery: a clinical case-series. Eur Arch Otorhinolaryngol. 10.1007/s00405-023-08282-5 DOI: 10.1007/s00405-023-08282-5
Cuny F, Babin E, Lacau-Saint-Guily J, Baujat B, Bensadoun R, Bozec A, Chevalier D, Choussy O, Deneuve S, Fakhry N, Guigay J, Makeieff M, Merol JC, Mouawad F, Pavillet J, Rebiere C, Righini C, Sostras MC, Tournaille M, Vergez S, SFORL work group (2015) French Society of ENT (SFORL) guidelines for care pathway organization in head and neck oncology (short version). Early management of head and neck cancer. Eur Ann Otorhinolaryngol Head Neck Dis 132(4):205–208. 10.1016/j.anorl.2015.06.007 DOI: 10.1016/j.anorl.2015.06.007
Verdonck-de Leeuw I, Dawson C, Licitra L, Eriksen JG, Hosal S, Singer S, Laverty DP, Golusinski W, Machczynski P, Varges Gomes A, Girvalaki C, Simon C, Leemans CR (2022) European Head and Neck Society recommendations for head and neckcancer survivorship care. Oral Oncol 133:106047. 10.1016/j.oraloncology.2022.106047 DOI: 10.1016/j.oraloncology.2022.106047
Lydiatt WM et al (2017) Head and Neck cancers-major changes in the American Joint Committee on cancer eighth edition cancer staging manual. CA Cancer J Clin 67(2):122–137 DOI: 10.3322/caac.21389
Piazza C, Paderno A, Sjogren EV, Bradley PJ, Eckel HE, Mäkitie A, Matar N, Paleri V, Peretti G, Puxeddu R, Quer M, Remacle M, Vander Poorten V, Vilaseca I, Simo R (2021) Salvage carbon dioxide transoral laser microsurgery for laryngeal cancer after (chemo)radiotherapy: a European Laryngological Society consensusstatement. Eur Arch Otorhinolaryngol 278(11):4373–4381. 10.1007/s00405-021-06957-5 DOI: 10.1007/s00405-021-06957-5
Radulesco T, Saibene AM, Michel J, Vaira LA, Lechien JR (2023) ChatGPT-4 Performance in Rhinology: A Clinical Case-Series. Revision. Int For Allerg Rhinol
Lechien JR, Briganti G, Vaira LA (2023) Accuracy of ChatGPT-3.5 and -4 in providing scientific references in otolaryngology-head and neck surgery. Eur Arch Otorhinolaryngol
