Download PDF
CC BY-NC-ND 4.0 · Endosc Int Open 2024; 12(04): E600-E603
DOI: 10.1055/a-2289-9334
Original article

Using a customized GPT to provide guideline-based recommendations for management of pancreatic cystic lesions

Yuri Gorelik 
1   Gastroenterology, Department of Internal Medicine D, Rambam Health Care Campus, Haifa, Israel (Ringgold ID: RIN58878)
,
Itai Ghersin
1   Gastroenterology, Department of Internal Medicine D, Rambam Health Care Campus, Haifa, Israel (Ringgold ID: RIN58878)
,
Tarek Arraf
1   Gastroenterology, Department of Internal Medicine D, Rambam Health Care Campus, Haifa, Israel (Ringgold ID: RIN58878)
,
Offir Ben-Ishay 
2   Surgery, Rambam Health Care Campus, Haifa, Israel (Ringgold ID: RIN58878)
,
Amir Klein‡
1   Gastroenterology, Department of Internal Medicine D, Rambam Health Care Campus, Haifa, Israel (Ringgold ID: RIN58878)
,
Iyad Khamaysi‡
3   Gastroenterology, Rambam MC, Kfar Kana, Israel
› Author Affiliations
› Further Information
Also available at
   Permissions and Reprints

Abstract

Background and study aims Rising prevalence of pancreatic cysts and inconsistent management guidelines necessitate innovative approaches. New features of large language models (LLMs), namely custom GPT creation, provided by ChatGPT can be utilized to integrate multiple guidelines and settle inconsistencies.

Methods A custom GPT was developed to provide guideline-based management advice for pancreatic cysts. Sixty clinical scenarios were evaluated by both the custom GPT and gastroenterology experts. A consensus was reached between experts and review of guidelines and the accuracy of recommendations provided by the custom GPT was evaluated and compared with experts.

Results The custom GPT aligned with expert recommendations in 87% of scenarios. Initial expert recommendations were correct in 97% and 87% of cases, respectively. No significant difference was observed between the accuracy of custom GPT and the experts. Agreement analysis using Cohen's and Fleiss' Kappa coefficients indicated consistency among experts and the custom GPT.

Conclusions This proof-of-concept study shows the custom GPT's potential to provide accurate, guideline-based recommendations for pancreatic cyst management, comparable to expert opinions. The study highlights the role of advanced features of LLMs in enhancing clinical decision-making in fields with significant practice variability.

Keywords

Pancreas - Endoscopic ultrasonography - Fine-needle aspiration/biopsy - Pancreatobiliary (ERCP/PTCD) - MRCP topics


Publication History

Received: 02 February 2024

Accepted: 15 March 2024

Accepted Manuscript online:
18 March 2024

Article published online:
26 April 2024

© 2024. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial-License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/).

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

Letter to this article:

Comment on “Using a customized GPT to provide guideline-based recommendations for management of pancreatic cystic lesions”Endosc Int Open 2024; 12(06): E810-E810
DOI: 10.1055/a-2335-8369

Comment to this article:

Endoscopy International Open – recently publishedEndoscopy 2024; 56(07): 555-555
DOI: 10.1055/a-2280-6811

 

  • References

  • 1 Schweber AB, Agarunov E, Brooks C. et al. Prevalence, incidence, and risk of progression of asymptomatic pancreatic cysts in large sample real-world data. Pancreas 2021; 50: 1287-1292
    CrossrefPubMedSearch in Google Scholar
  • 2 Vege SS, Ziring B, Jain R. et al. American gastroenterological association institute guideline on the diagnosis and management of asymptomatic neoplastic pancreatic cysts. Gastroenterology 2015; 148: 819-822
    CrossrefPubMedSearch in Google Scholar
  • 3 Tanaka M, Fernández-del Castillo C, Kamisawa T. et al. Revisions of international consensus Fukuoka guidelines for the management of IPMN of the pancreas. Pancreatology 2017; 17: 738-753
    CrossrefPubMedSearch in Google Scholar
  • 4 Del Chiaro M, Besselink MG, Scholten L. et al. European evidence-based guidelines on pancreatic cystic neoplasms. Gut 2018; 67: 789-804
    CrossrefPubMedSearch in Google Scholar
  • 5 Elta GH, Enestvedt BK, Sauer BG. et al. ACG Clinical Guideline: Diagnosis and Management of Pancreatic Cysts. Am J Gastroenterol 2018; 113: 464-479
    CrossrefPubMedSearch in Google Scholar
  • 6 van Huijgevoort NCM, del Chiaro M, Wolfgang CL. et al. Diagnosis and management of pancreatic cystic neoplasms: current evidence and guidelines. Nat Rev Gastroenterol Hepatol 2019 1611 2019; 16: 676-689
    CrossrefPubMedSearch in Google Scholar
  • 7 Schenck RJ, Miller FH, Keswani RN. The Surveillance patterns of incidentally detected pancreatic cysts vary widely and infrequently adhere to guidelines. Pancreas 2019; 48: 883-887
    CrossrefPubMedSearch in Google Scholar
  • 8 Ray PP. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet Things Cyber-Physical Syst 2023; 3: 121-154
    CrossrefPubMedSearch in Google Scholar
  • 9 Dave T, Athaluri SA, Singh S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front Artif Intell 2023; 6: 75
    CrossrefPubMedSearch in Google Scholar
  • 10 Gorelik Y, Ghersin I, Maza I. et al. Harnessing language models for streamlined postcolonoscopy patient management: a novel approach. Gastrointest Endosc 2023; 98: 639-641.e4
    CrossrefPubMedSearch in Google Scholar
  • 11 Benoit JRA. ChatGPT for Clinical Vignette Generation, Revision, and Evaluation. medRxiv 2023; 2023.02.04.23285478.
    CrossrefPubMed
  • 12 Okasha HH, Awad A, El-Meligui A. et al. Cystic pancreatic lesions, the endless dilemma. World J Gastroenterol 2021; 27: 2664-2680
    CrossrefPubMedSearch in Google Scholar
  • 13 Marchegiani G, Pollini T, Burelli A. et al. Surveillance for presumed BD-IPMN of the pancreas: Stability, size, and age identify targets for discontinuation. Gastroenterology 2023; 165: 1016-1024
    CrossrefPubMedSearch in Google Scholar