Endoscopy 2011; 43(7): 579-584
DOI: 10.1055/s-0030-1256434
Original article

© Georg Thieme Verlag KG Stuttgart · New York

Interobserver agreement for endosonography in the diagnosis of pancreatic cysts

K.  de Jong1 , T.  Verlaan1 , M.  G.  Dijkgraaf2 , J.  W.  Poley3 , H.  van Dullemen4 , M.  J.  Bruno3 , P.  Fockens1
  • 1Department of Gastroenterology and Hepatology, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
  • 2Department of Biostatistics and Clinical Epidemiology, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
  • 3Department of Gastroenterology and Hepatology, Erasmus Medical Center, University Medical Center Rotterdam, Rotterdam, The Netherlands
  • 4Department of Gastroenterology and Hepatology, University Medical Center Groningen, The Netherlands
Weitere Informationen

Publikationsverlauf

submitted 28 October 2010

accepted after revision 31 January 2011

Publikationsdatum:
29. Juni 2011 (online)

Background and study aims: Endosonography is considered a valuable technique in the evaluation of pancreatic cysts. The aim of the present study is to assess interobserver agreement, in three different observer groups, regarding EUS for characterization of pancreatic cysts.

Patients and methods: Video sequences of 40 EUS procedures for pancreatic cysts were prepared. Three groups of observers had different levels of EUS experience: group 1 comprised four experts with extensive EUS experience, group 2 had four “semi-experts” with limited EUS experience, and group 3 (novices) comprised four non-expert resident physicians without EUS experience. Features scored included septations, nodules, solid components, and pancreatic duct communication. A presumptive diagnosis had to be specified. The intraclass correlation coefficient (ICC) was used, with agreement classed as excellent (> 0.80), good (0.61 – 0.80), moderate (0.41 – 0.60), fair (0.20 – 0.40), and poor (< 0.20).

Results: Agreement regarding nodules was good among experts (ICC 0.65) and fair in the semi-expert and novice groups (ICC 0.32 and 0.37, respectively). For presence of solid components there was significantly higher agreement among experts (ICC 0.52) compared with the other two groups (semi-experts 0.09, and novices 0.03). Agreement regarding specific diagnosis was moderate in the expert group (0.43), poor among the semi-experts (0.09), and fair among the novices (0.30).

Conclusions: Interobserver agreement among expert endosonographers was mostly moderate for characteristics of pancreatic cysts. However, interobserver agreement for experts was equal to or higher than that in the semi-expert and in the novice groups.

References

  • 1 de Jong K, Nio C Y, Hermans J J et al. High prevalence of pancreatic cysts detected by screening magnetic resonance imaging examinations.  Clin Gastroenterol Hepatol. 2010;  8 806-811
  • 2 Fernandez-del C C, Targarona J, Thayer S P et al. Incidental pancreatic cysts: clinicopathologic characteristics and comparison with symptomatic patients.  Arch Surg. 2003;  138 427-430
  • 3 Warshaw A L, Compton C C, Lewandrowski K et al. Cystic tumors of the pancreas. New clinical, radiologic, and pathologic observations in 67 patients.  Ann Surg. 1990;  212 432-443
  • 4 Kiely J M, Nakeeb A, Komorowski R A et al. Cystic pancreatic neoplasms: enucleate or resect?.  J Gastrointest Surg. 2003;  7 890-897
  • 5 Talamini M A, Pitt H A, Hruban R H et al. Spectrum of cystic tumors of the pancreas.  Am J Surg. 1992;  163 117-123
  • 6 Sugiyama M, Izumisato Y, Abe N et al. Predictive factors for malignancy in intraductal papillary-mucinous tumours of the pancreas.  Br J Surg. 2003;  90 1244-1249
  • 7 Murakami Y, Uemura K, Morifuji M et al. Mucinous cystic neoplasm of the pancreas with ovarian-type stroma arising in the head of the pancreas: case report and review of the literature.  Dig Dis Sci. 2006;  51 629-632
  • 8 Brugge W R. The role of EUS in the diagnosis of cystic lesions of the pancreas.  Gastrointest Endosc. 2000;  52 S18-S22
  • 9 Ariyama J, Suyama M, Satoh K et al. Endoscopic ultrasound and intraductal ultrasound in the diagnosis of small pancreatic tumors.  Abdom Imaging. 1998;  23 380-386
  • 10 Brandwein S L, Farrell J J, Centeno B A et al. Detection and tumor staging of malignancy in cystic, intraductal, and solid tumors of the pancreas by EUS.  Gastrointest Endosc. 2001;  53 722-727
  • 11 Ahmad N A, Kochman M L, Lewis J D et al. Can EUS alone differentiate between malignant and benign cystic lesions of the pancreas?.  Am J Gastroenterol. 2001;  96 3295-3300
  • 12 Ahmad N A, Kochman M L, Brensinger C et al. Interobserver agreement among endosonographers for the diagnosis of neoplastic versus non-neoplastic pancreatic cystic lesions.  Gastrointest Endosc. 2003;  58 59-64
  • 13 Hernandez L V, Bhutani M S. Endoscopic ultrasound and pancreatic cysts: a sticky situation!.  Am J Gastroenterol. 2001;  96 3229-3230
  • 14 Brugge W R, Lewandrowski K, Lee-Lewandrowski E et al. Diagnosis of pancreatic cystic neoplasms: a report of the cooperative pancreatic cyst study.  Gastroenterology. 2004;  126 1330-1336
  • 15 Koito K, Namieno T, Nagakawa T et al. Solitary cystic tumor of the pancreas: EUS-pathologic correlation.  Gastrointest Endosc. 1997;  45 268-276
  • 16 Frossard J L, Amouyal P, Amouyal G et al. Performance of endosonography-guided fine needle aspiration and biopsy in the diagnosis of pancreatic cystic lesions.  Am J Gastroenterol. 2003;  98 1516-1524
  • 17 Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit.  Psychol Bull. 1968;  70 213-220
  • 18 Walter S D, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies.  Stat Med. 1998;  17 101-110
  • 19 Brugge W R, Lewandrowski K, Lee-Lewandrowski E et al. Diagnosis of pancreatic cystic neoplasms: a report of the cooperative pancreatic cyst study.  Gastroenterology. 2004;  126 1330-1336

P. FockensMD, PhD 

Academic Medical Center
University of Amsterdam

P.O. Box 22700
1100 DE Amsterdam
The Netherlands

Fax: +31-20-6917033

eMail: p.fockens@amc.nl