Ultraschall Med 2019; 40(04): 481-487
DOI: 10.1055/a-0837-0712
Original Article
© Georg Thieme Verlag KG Stuttgart · New York

Interrater Reliability of Ultrasound in the Diagnosis of Sialolithiasis

Interrater-Reliabilität von Ultraschall bei der Diagnose von Sialolithiasis
Miguel Goncalves*
1   Department of Otorhinolaryngology, Head-and-Neck-Surgery, FAU Medical School Friedrich-Alexander-University of Erlangen-Nuremberg, Erlangen, Germany
,
Konstantinos Mantsopoulos*
1   Department of Otorhinolaryngology, Head-and-Neck-Surgery, FAU Medical School Friedrich-Alexander-University of Erlangen-Nuremberg, Erlangen, Germany
,
Mirco Lothar Schapher
1   Department of Otorhinolaryngology, Head-and-Neck-Surgery, FAU Medical School Friedrich-Alexander-University of Erlangen-Nuremberg, Erlangen, Germany
,
Johannes Zenk
2   Department of Otorhinolaryngology, Head-and-Neck-Surgery, Klinikum Augsburg, Germany
,
Alessandro Bozzato
3   Department of Otorhinolaryngology, Head-and-Neck-Surgery, University-Hospital Saarlanddical School, Homburg, Germany
,
Julian Kuenzel
4   Department of Otorhinolaryngology, Head-and-Neck-Surgery, Mainz-University-Hospital, Erlangen, Germany
,
Pamela Zengel
5   Department of Otorhinolaryngology, Head-and-Neck-Surgery, University of Munich-Grosshadern Campus, Munich, Germany
,
Heinrich Iro
1   Department of Otorhinolaryngology, Head-and-Neck-Surgery, FAU Medical School Friedrich-Alexander-University of Erlangen-Nuremberg, Erlangen, Germany
,
Michael Koch
1   Department of Otorhinolaryngology, Head-and-Neck-Surgery, FAU Medical School Friedrich-Alexander-University of Erlangen-Nuremberg, Erlangen, Germany
› Author Affiliations
Further Information

Publication History

16 July 2018

12 January 2019

Publication Date:
07 February 2019 (online)

Abstract

Purpose The aim of this study was to assess the interrater reliability of ultrasound for diagnosing sialolithiasis.

Materials and Methods A total of 100 consecutive patients with signs of obstructive sialadenopathy were evaluated. The patients all underwent ultrasound examinations in a standardized manner conducted by one specialist with extensive experience in the management of salivary gland disorders and proficiency in head and neck ultrasonography. The video recordings were sent to six colleagues with comparable experience without providing any further information about the patients’ medical history and physical examination.

Results The overall agreement between the seven observers was substantial, with a κ of 0.765 for the 100 cases and a percentage agreement level of 88.29 ± 3.01 % (range: 83–94 %). The range of agreement on this video set for observer pairs varied from substantial to almost perfect agreement (0.663 to 0.878). Among the few false-negative findings (5.4 %), 71.8 % were due to distal sialolithiasis. Two-thirds of the false-positive findings (3.7 %) were due to fibrotic stenosis.

Conclusion The study confirmed the diagnostic value of ultrasound in sialolithiasis and demonstrated a very high level of interrater agreement, even in the absence of additional clinical patient information, thus further underscoring the importance of ultrasound as the examination of first choice in sialolithiasis.

Zusammenfassung

Ziel Das Ziel dieser Studie war die Beurteilung der Interrater-Reliabilität der Sonografie in der Diagnose der Sialolithiasis.

Material und Methoden Insgesamt wurden 100 konsekutive Patienten mit Anzeichen einer obstruktiven Sialadenopathie untersucht. Die Patienten unterzogen sich einer standardisierten sonografischen Untersuchung, die von einem HNO- Arzt mit umfangreicher Erfahrung in der Sonographie und in der Behandlung von Speicheldrüsenerkrankungen durchgeführt wurde. Die Videoaufnahmen wurden an 6 Kollegen mit vergleichbarer Erfahrung gesendet, ohne weitere Informationen über die Krankengeschichte und die körperliche Untersuchung der Patienten zu geben.

Ergebnisse Die Gesamtübereinstimmung zwischen den 7 Beobachtern war substanziell, mit einem κ von 0,765 für die 100 Fälle und einem prozentualen Übereinstimmungsgrad von 88,29 ± 3,01 % (Bereich 83–94 %). Die Bandbreite der Übereinstimmung in diesem Video-Set für Beobachterpaare variierte von substanziell bis nahezu perfekt (0,663 bis 0,878). Unter den wenigen falsch negativen Befunden (5,4 %) waren 71,8 % auf distale Sialolithiasis zurückzuführen. Zwei Drittel der falsch positiven Befunde (3,7 %) waren auf eine fibrotische Stenose zurückzuführen.

Schlussfolgerung Die Studie bestätigte den diagnostischen Wert von Ultraschall bei Sialolithiasis und zeigte eine sehr hohe Interrater-Übereinstimmung, auch ohne zusätzliche klinische Patienteninformationen. Dies unterstreicht die Bedeutung von Ultraschall für die Untersuchung der ersten Wahl bei Sialolithiasis.

* These authors contributed equally to the article.


 
  • References

  • 1 Escudier MP, McGurk M. Symptomatic sialoadenitis and sialolithiasis in the English population, an estimate of the cost of hospital treatment. Br Dent J 1999; 186: 463-466
  • 2 Schrøder SA, Andersson M, Wohlfahrt J. et al. Incidence of sialolithiasis in Denmark: a nationwide population-based register study. Eur Arch Otorhinolaryngol 2017; 274: 1975-1981
  • 3 Dreiseidler T, Ritter L, Rothamel D. et al. Salivary calculus diagnosis with 3-dimensional cone-beam computed tomography. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 2010; 110: 94-100
  • 4 Purcell YM, Kavanagh RG, Cahalane AM. et al. The Diagnostic Accuracy of Contrast-Enhanced CT of the Neck for the Investigation of Sialolithiasis. AJNR Am J Neuroradiol 2017; 38: 2161-2166
  • 5 Jadu FM, Lam EWN. A comparative study of the diagnostic capabilities of 2D plain radiograph and 3D cone beam CT sialography. Dentomaxillofac Radiol 2013; 42: 20110319
  • 6 Becker M, Marchal F, Becker CD. et al. Sialolithiasis and salivary ductal stenosis: diagnostic accuracy of MR Sialography with a three-dimensional extended-phase conjugate-symmetry rapid spin-echo sequence. Radiology 2000; 217: 347-358
  • 7 Capaccio P, Cuccarini V, Ottaviani F. et al. Comparative ultrasonographic, magnetic reseonance sialographic and videoendoscopic assessment of salivary duct disorders. Ann Otol Rhinol Laryngol 2008; 117: 245-252
  • 8 Kalinowski M, Heverhagen JT, Rehberg E. et al. Comparative study of MR Sialography and digital subtraction sialography for benign salivary gland disorders. AJNR Am J Neuroradiol 2002; 23: 1485-1492
  • 9 Al-Nawas B, Beutner D, Geisthoff U. et al. The new S2k AWMF guideline for the treatment of obstructive sialadenitis [in German]. Laryngorhinootologie 2014; 93: 87-94
  • 10 Goncalves M, Schapher M, Iro H. et al. Value of sonography in the diagnosis of sialolithiasis: comparison with the reference standard of direct stone identification. J Ultrasound Med 2017; 36: 2227-2235
  • 11 Goncalves M, Mantsopoulos K, Schapher M. et al. Ultrasound supplemented by sialendoscopy: diagnostic value in sialolithiasis. Otolaryngol Head Neck Surg 2018; DOI: 10.1177/0194599818775946.
  • 12 Bozzato A, Hertel V, Bumm K. et al. Salivary simulation with ascorbic acid enhances sonographic diagnosis of obstructive sialadenitis. J Clin Ultrasound 2009; 37: 329-332
  • 13 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-174
  • 14 Schwarz D, Kabbasch C, Scheer M. et al. Comparative analysis of sialendoscopy, sonography, and CBCT in the detection of sialolithiasis. Laryngoscope 2015; 125: 1098-1101
  • 15 Terraz S, Poletti PA, Dulguerov P. et al. How reliable is sonography in the assessment of sialolithiasis?. Am J Roentgenol 2013; 201: W104-W109
  • 16 Jäger L, Menauer F, Holzknecht N. et al. Sialolithiasis: MR sialography of the submandibular duct—an alternative to conventional sialography and US?. Radiology 2000; 216: 665-671
  • 17 Thomas WW, Douglas JE, Rassekh CH. Accuracy of ultrasonography and computed tomography in the evaluation of patients undergoing sialendoscopy for sialolithiasis. Otolaryngol Head Neck Surg 2017; 156: 834-839
  • 18 Larson AR, Aubin-Pouliot A, Delagnes E. et al. Surgeon-performed ultrasound for chronic obstructive sialadenitis helps predict sialendoscopic findings and outcomes. Otolaryngol Head Neck Surg 2017; 157: 973-980
  • 19 Sigismund PE, Zenk J, Koch M. et al. Nearly 3000 salivary stones: some clinical and epidemiologic aspects. Laryngoscope 2015; 125: 1879-1882