Response to Letter to the editor: Interrater Reliability of Ultrasound in the Diagnosis of Sialolithiasis: Methodological Issues. Interrater Reliability of Ultrasound: Methodological Issues

Thank you for your constructive comments on our manuscript. In our study [1], we evaluated 100 consecutive patients with signs of obstructive sialadenopathy. The patients all underwent ultrasound examinations in a standardized manner conducted by one specialist (E1) with extensive experience in the management of salivary gland disorders and proficiency in head and neck ultrasonography. The video recordings were sent to six colleagues (E2–E7) with comparable experience without providing any further information about the patients’ medical history and physical examination.

• References

• 1 Goncalves M, Mantsopoulos K, Schapher ML. et al. Interrater Reliability of Ultrasound in the Diagnosis of Sialolithiasis. Ultraschall in Med 2019; DOI: 10.1055/a-0837-0712. . [Epub ahead of print]
• 2 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-174
• 3 Gwet KL. Computing inter-rater reliability and its variance in the presence of high agreement. British Journal of Mathematical and Statistical Psychology 2008; 61: 39-48
• 4 Fleiss JL. Statistical methods for rates and proportions. 2nd. ed. New York: John Wiley; 1981: 38-46