Ultraschall Med 2015; 36(02): 162-167
DOI: 10.1055/s-0034-1366467
Original Article
© Georg Thieme Verlag KG Stuttgart · New York

Diagnostic Accuracy and Interobserver Agreement of Quasistatic Ultrasound Elastography in the Diagnosis of Thyroid Nodules

Diagnostische Genauigkeit und Interobserver-Übereinstimmung der Quasistatischen-Ultraschall-Elastografie bei der Diagnose von Schilddrüsenknoten
V. Cantisani
1   Department of Radiology, “Sapienza” University of Rome, Rome, Italy
,
P. Lodise
1   Department of Radiology, “Sapienza” University of Rome, Rome, Italy
,
G. Di Rocco
2   Department of Surgical Sciences, “Sapienza” University of Rome, Rome, Italy
,
H. Grazhdani
1   Department of Radiology, “Sapienza” University of Rome, Rome, Italy
,
D. Giannotti
2   Department of Surgical Sciences, “Sapienza” University of Rome, Rome, Italy
,
G. Patrizi
2   Department of Surgical Sciences, “Sapienza” University of Rome, Rome, Italy
,
E. Medvedyeva
1   Department of Radiology, “Sapienza” University of Rome, Rome, Italy
,
M. Olive
1   Department of Radiology, “Sapienza” University of Rome, Rome, Italy
,
C. Fioravanti
1   Department of Radiology, “Sapienza” University of Rome, Rome, Italy
,
L. Giacomelli
2   Department of Surgical Sciences, “Sapienza” University of Rome, Rome, Italy
,
C. Chiesa
2   Department of Surgical Sciences, “Sapienza” University of Rome, Rome, Italy
,
A. Redler
2   Department of Surgical Sciences, “Sapienza” University of Rome, Rome, Italy
,
C. Catalano
1   Department of Radiology, “Sapienza” University of Rome, Rome, Italy
,
F. D’Ambrosio
1   Department of Radiology, “Sapienza” University of Rome, Rome, Italy
,
P. Ricci
1   Department of Radiology, “Sapienza” University of Rome, Rome, Italy
› Author Affiliations
Further Information

Publication History

14 January 2013

26 March 2014

Publication Date:
23 June 2014 (online)

Abstract

Purpose: To assess the best technique and the diagnostic accuracy of Quasistatic Ultrasound Elastography (QUE) in thyroid nodules. Interobserver agreement was also evaluated.

Materials and Methods: A preliminary study of 50 patients with 54 thyroid nodules was performed with quantitative software in order to define the best cut-off value of different imaging methods. All patients underwent total thyroidectomy and histopathology findings served as the standard of reference. Thereafter, 154 nodules in 137 consecutive patients were prospectively evaluated by three operators. Findings at fine-needle aspiration cytology and histopathology (N = 60) served as the standard of reference.

Results: The most accurate technique was the axial peri-intranodular measurement method which achieved an area under the ROC curve of 0.961 (95 %CI 0.848 – 1.00) and had an optimal cut-off value of 3.00. QUE in the differentiation of thyroid nodules showed for operator 1: sensitivity 90 % (95 %CI 73.5 – 97.9 %), specificity 92.7 % (95 %CI 86.7 – 96.6 %), LR+ 12.40 (6.54 – 23.50), LR- 0.11 (0.04 – 0.32) and accuracy 91.4 % (95 %CI 85.4 – 97.3 %); for operator 2: sensitivity 86.7 % (95 %CI 69.3 – 96.2 %), specificity 87.1 % (95 %CI 79.9 – 92.4 %), LR+ 6.72 (4.16 – 10.80), LR- 0.15 (0.06 – 0.38) and accuracy 86.9 % (95 %CI 80.0 – 93.7 %); for operator 3: sensitivity 80 % (95 %CI 61.4 – 92.3 %), specificity 83.9 % (95 %CI 76.2 – 89.9 %), LR+ 4.96 (3.20 – 7.70), LR- 0.24 (0.12 – 0.49) and accuracy 81.9 % (95 %CI 74.0 – 89.9 %). Interobserver agreement values between operator 1 and operator 2 (k = 0.79) (p < 0.05, 95 %CI 0.684 – 0.904), between operator 1 and operator 3 (k = 0.73, 95 %CI: 0.607 – 0.854) and between operator 2 and operator 3 (k = 0.71, 95 %CI: 0.584 – 0.835) were significant.

Conclusion: QUE provides accurate quantitative evaluation of thyroid nodules with low interobserver variability.

Zusammenfassung

Ziel: Die Ermittlung der besten Technik und der diagnostischen Genauigkeit der Quasistatischen-Ultraschall-Elastografie (QUE) von Schilddrüsenknoten. Die Interobserver-Übereinstimmung wurde ebenfalls bewertet.

Material und Methoden: Mit einer quantitativen Software wurde eine Vorstudie an 50 Patienten mit 54 Schilddrüsenknoten durchgeführt, um für verschiedene bildgebende Verfahren die optimalen Grenzwerte festzulegen. Alle Patienten hatten eine Thyreoidektomie und die histopathologischen Befunde dienten als Referenzstandard. Im Anschluss wurden 154 Knoten von 137 Folgepatienten prospektiv von drei Bedienern bewertet. Als Standardreferenz dienten die Befunde der Feinnadelaspirationszytologie und der Histopathologie (N = 60).

Ergebnisse: Die genaueste Technik war die axiale peri-intranoduläre Messmethode, mit der eine Fläche unter der ROC-Kurve von 0,961 (95 %CI 0,848 – 1,00) erzielt wurde und die einen optimalen Grenzwert von 3,00 hatte. Die QUE zeigte bei der Differenzierung von Schilddrüsenknoten für den Bediener 1 folgende Werte: Sensitivität 90 % (95 %CI 73,5 – 97,9 %), Spezifität 92,7 % (95 %CI 86,7 – 96,6 %), LR+ 12,40 (6,54 – 23,50), LR- 0,11 (0,04 – 0,32) und Genauigkeit 91,4 % (95 %CI 85,4 – 97,3 %); für Bediener 2: Sensitivität 86,7 % (95 %CI 69,3 – 96,2 %), Spezifität 87,1 % (95 %CI 79,9 – 92,4 %), LR+ 6,72 (4,16 – 10,80), LR- 0,15 (0,06 – 0,38) und Genauigkeit 86,9 % (95 %CI 80,0 – 93,7 %); für Bediener 3: Sensitivität 80 % (95 %CI 61,4 – 92,3 %), Spezifität 83,9 % (95 %CI 76,2 – 89,9 %), LR+ 4,96 (3,20 – 7,70), LR- 0,24 (0,12 – 0,49) und Genauigkeit 81,9 % (95 %CI 74,0 – 89,9 %). Die Interobserver-Übereinstimmung zwischen Bediener 1 und Bediener 2 (k = 0,79) (p < 0,05; 95 %CI 0,684 – 0,904), zwischen Bediener 1 und Bediener 3 (k = 0,73; 95 %CI: 0,607 – 0,854) und zwischen Bediener 2 und Bediener 3 (k = 0,71; 95 %CI: 0,584 – 0,835) ergab jeweils signifikante Werte.

Schlussfolgerung: Die QUE ermöglicht die genaue quantitative Bewertung von Schilddrüsenknoten bei einer niedrigen Interobserver-Variabilität.

 
  • References

  • 1 Dean DS, Gharib H. Epidemiology of thyroid nodules. Best Pract Res Clin Endocrinol Metab 2008; 22: 901-911
  • 2 Frates MC, Benson CB, Charboneau JW et al. Management of thyroid nodules detected at US: Society of Radiologists in ultrasound consensus conference statement. Radiology 2005; 237: 794-800
  • 3 Hoang JK, Lee WK, Lee M et al. US features of thyroid malignancy: pearls and pitfalls. Radiographics 2007; 27: 847-860
  • 4 Rodrigues HG, Pontes AA, Adan LF. Use of molecular markers in samples obtained from preoperative aspiration of thyroid. Endocr J 2012; 59 (05) 417-424 Epub 2012 Mar 23.
  • 5 Tee YY, Lowe AJ, Brand CA et al. Fine-needle aspiration may miss a third of all malignancy in palpable thyroid nodules: a comprehensive literature review. Ann Surg 2007; 246: 714-720
  • 6 Peng Y, Wang HH. A meta-analysis of comparing fine-needle aspiration and frozen section for evaluating thyroid nodules. Diagn Cytopathol 2008; 36: 916-920
  • 7 Oertel YC, Miyahara-Felipe L, Mendoza MG et al. Value of repeated fine needle aspirations of the thyroid: an analysis of over ten thousand FNAs. Thyroid 2007; 17: 1061-1066
  • 8 Yang J, Schnadig V, Logrono R et al. Fine-needle aspiration of thyroid nodules: a study of 4703 patients with histological and clinical correlations. Cancer 2007; 111: 306-315
  • 9 Donatini G, Masoni T, Ricci V et al. Acute respiratory distress following fine needle aspiration of thyroid nodule: case report and review of the literature. G Chir 2010; 31: 387-389
  • 10 Garra BS. Elastography: current status, future prospects, and making it work for you. Ultrasound Q 2011; 27: 177-186
  • 11 Rago T, Santini F, Scutari M et al. Elastography: new developments in ultrasound for predicting malignancy in thyroid nodules. J Clin Endocrinol Metab 2007; 92: 2917-2922
  • 12 Park SH, Kim SJ, Kim EK et al. Interobserver agreement in assessing the sonographic and elastographic features of malignant thyroid nodules. Am J Roentgenol Am J Roentgenol 2009; 193: W416-W423
  • 13 Bae U, Dighe M, Dubinsky T et al. Ultrasound thyroid elastography using carotid artery pulsation: preliminary study. J Ultrasound Med 2007; 26: 797-805
  • 14 Dighe M, Bae U, Richardson ML et al. Differential diagnosis of thyroid nodules with US elastography using carotid artery pulsation. Radiology 2008; 248: 662-669
  • 15 Lim DJ, Luo S, Kim MH et al. Interobserver agreement and intraobserver reproducibility in thyroid ultrasound elastography. Am J Roentgenol Am J Roentgenol 2012; 198: 896-901
  • 16 Moon WJ, Jung SL et al. Thyroid Study Group, Korean Society of Neuro- and Head and Neck Radiology Benign and malignant thyroid nodules: US differentiation—multicenter retrospective study. Radiology 2008; 247: 762-770
  • 17 Luo S, Lim DJ, Kim Y. Objective ultrasound elastography scoring of thyroid nodules using spatiotemporal strain information. Medical Physics 2012; 39: 1182-1189
  • 18 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-174
  • 19 Bamber J, Cosgrove D, Dietrich CF et al. EFSUMB guidelines and recommendations on the clinical use of ultrasound elastography. Part 1: Basic principles and technology. Ultraschall in Med 2013; 34: 169-184
  • 20 Bojunga J, Herrmann E, Meyer G et al. Real-time elastography for the differentiation of benign and malignant thyroid nodules: a meta-analysis. Thyroid 2010; 20: 1145-1150
  • 21 Xing P, Wu L, Zhang C et al. Differentiation of benign from malignant thyroid lesions: calculation of the strain ratio on thyroid sonoelastography. Ultrasound Med 2011; 30: 663-669
  • 22 Cantisani V, D'Andrea V, Biancari F et al. Prospective evaluation of multiparametric ultrasound and quantitative elastosonography in the differential diagnosis of benign and malignant thyroid nodules: Preliminary experience. Eur J Radiol 2012; 81: 2678-2683
  • 23 Cantisani V, D’Andrea V, Mancuso E et al. “Prospective evaluation in 123 patients of strain ratio as provided by quantitative Elastosonography and multiparametric ultrasound evaluation (ultrasound score) for the characterization of thyroid nodule”. Radiol Med 2013; 118: 1011-1021
  • 24 Merino S, Arrazola J, Càrdenas A et al. Utility and interobserver agreementof UE in the detection of malignant thyroid nodules in clinical care. Am J of Neuroradiol 2011; 32: 2142-2148
  • 25 Ragazzoni F, Deandrea M, Mormile A et al. High Diagnostic Accuracy and Interobserver Reliability of Real-Time Elastography in the Evaluation of Thyroid Nodules. Ultrasound Med Biol 2012; 38: 1154-1162
  • 26 Cosgrove D, Piscaglia F, Bamber J et al. EFSUMB guidelines and recommendations on the clinical use of ultrasound elastography. Part 2: Clinical applications. Ultraschall in Med 2013; 34: 238-253