Deep Learning in the Detection of Rare Fractures – Development of a “Deep Learning Convolutional Network” Model for Detecting Acetabular Fractures

Abstract

Background Fracture detection by artificial intelligence and especially Deep Convolutional Neural Networks (DCNN) is a topic of growing interest in current orthopaedic and radiological research. As learning a DCNN usually needs a large amount of training data, mostly frequent fractures as well as conventional X-ray are used. Therefore, less common fractures like acetabular fractures (AF) are underrepresented in the literature. The aim of this pilot study was to establish a DCNN for detection of AF using computer tomography (CT) scans.

Methods Patients with an acetabular fracture were identified from the monocentric consecutive pelvic injury registry at the BG Trauma Center XXX from 01/2003 – 12/2019. All patients with unilateral AF and CT scans available in DICOM-format were included for further processing. All datasets were automatically anonymised and digitally post-processed. Extraction of the relevant region of interests was performed and the technique of data augmentation (DA) was implemented to artificially increase the number of training samples. A DCNN based on Med3D was used for autonomous fracture detection, using global average pooling (GAP) to reduce overfitting.

Results From a total of 2,340 patients with a pelvic fracture, 654 patients suffered from an AF. After screening and post-processing of the datasets, a total of 159 datasets were enrolled for training of the algorithm. A random assignment into training datasets (80%) and test datasets (20%) was performed. The technique of bone area extraction, DA and GAP increased the accuracy of fracture detection from 58.8% (native DCNN) up to an accuracy of 82.8% despite the low number of datasets.

Conclusion The accuracy of fracture detection of our trained DCNN is comparable to published values despite the low number of training datasets. The techniques of bone extraction, DA and GAP are useful for increasing the detection rates of rare fractures by a DCNN. Based on the used DCNN in combination with the described techniques from this pilot study, the possibility of an automatic fracture classification of AF is under investigation in a multicentre study.

Key words

acetabular fracture - artificial intelligence - machine learning - DCNN - fracture detection

^* shared authorship

^** shared last authorship

Publication History

Article published online:
26 July 2021

• References/Literatur

• 1 Herath SC, Pott H, Rollmann MFR. et al. Geriatric Acetabular Surgery: Letournelʼs Contraindications Then and Now-Data From the German Pelvic Registry. J Orthop Trauma 2019; 33 (Suppl. 02) S8-S13 DOI: 10.1097/BOT.0000000000001406.
• 2 Rollmann MF, Herath SC, Kirchhoff F. et al. Pelvic ring fractures in the elderly now and then – a pelvic registry study. Arch Gerontol Geriatr 2017; 71: 83-88 DOI: 10.1016/j.archger.2017.03.007.
• 3 Melhem E, Riouallon G, Habboubi K. et al. Epidemiology of pelvic and acetabular fractures in France. Orthop Traumatol Surg Res 2020; 106: 831-839 DOI: 10.1016/j.otsr.2019.11.019.
• 4 Best MJ, Buller LT, Quinnan SM. Analysis of Incidence and Outcome Predictors for Patients Admitted to US Hospitals with Acetabular Fractures from 1990 to 2010. Am J Orthop (Belle Mead NJ) 2018; DOI: 10.12788/ajo.2018.0083.
• 5 Andrich S, Haastert B, Neuhaus E. et al. Epidemiology of Pelvic Fractures in Germany: Considerably High Incidence Rates among Older People. PLoS One 2015; 10: e0139078 DOI: 10.1371/journal.pone.0139078.
• 6 Mandell JC, Weaver MJ, Khurana B. Computed tomography for occult fractures of the proximal femur, pelvis, and sacrum in clinical practice: single institution, dual-site experience. Emerg Radiol 2018; 25: 265-273 DOI: 10.1007/s10140-018-1580-4.
• 7 Cabarrus MC, Ambekar A, Lu Y. et al. MRI and CT of insufficiency fractures of the pelvis and the proximal femur. AJR Am J Roentgenol 2008; 191: 995-1001 DOI: 10.2214/AJR.07.3714.
• 8 Goodfellow I, Bengio Y, Courville A. Deep learning. An MIT Press Book. Im Internet (Stand: 26.03.2021): http://www.deeplearningbook.org
• 9 Chen S, Ma K, Zheng Y. Med3D: Transfer Learning for 3D Medical Image Analysis. arXiv; 2019 1904.00625v4 [cs.CV]. Im Internet (Stand: 29.03.2021): https://arxiv.org/abs/1904.00625
• 10 Bengio Y, Courville A, Vincent P. Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell 2013; 35: 1798-1828 DOI: 10.1109/TPAMI.2013.50.
• 11 Burrell J. How the machine ʼthinksʼ: Understanding opacity in machine learning algorithms. Big Data & Society 2016; DOI: 10.1177/2053951715622512.
• 12 Rowe M. An Introduction to Machine Learning for Clinicians. Acad Med 2019; 94: 1433-1436 DOI: 10.1097/ACM.0000000000002792.
• 13 Cha MJ, Chung MJ, Lee JH. et al. Performance of Deep Learning Model in Detecting Operable Lung Cancer With Chest Radiographs. J Thorac Imaging 2019; 34: 86-91 DOI: 10.1097/RTI.0000000000000388.
• 14 Huang Z, Liu D, Chen X. et al. Deep Convolutional Neural Network Based on Computed Tomography Images for the Preoperative Diagnosis of Occult Peritoneal Metastasis in Advanced Gastric Cancer. Front Oncol 2020; 10: 601869 DOI: 10.3389/fonc.2020.601869.
• 15 Tobler P, Cyriac J, Kovacs BK. et al. AI-based detection and classification of distal radius fractures using low-effort data labeling: evaluation of applicability and effect of training set size. Eur Radiol 2021; DOI: 10.1007/s00330-021-07811-2.
• 16 Kalmet PHS, Sanduleanu S, Primakov S. et al. Deep learning in fracture detection: a narrative review. Acta Orthop 2020; 91: 215-220 DOI: 10.1080/17453674.2019.1711323.
• 17 Tomita N, Cheung YY, Hassanpour S. Deep neural networks for automatic detection of osteoporotic vertebral fractures on CT scans. Comput Biol Med 2018; 98: 8-15 DOI: 10.1016/j.compbiomed.2018.05.011.
• 18 He K, Zhang X, Ren S. et al. Identity Mappings in Deep Residual Networks. arXiv; 2016 1603.05027v3 [cs.CV]. Im Internet (Stand: 29.03.2021): https://arxiv.org/abs/1603.05027
• 19 Srivastava N, Hinton GE, Krizhevsky A. et al. Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 2014; 15: 1929-1958
• 20 Lin M, Chen Q, Yan S. Network In Network. arXiv; 2013 1312.4400v3 [cs.NE]. Im Internet (Stand: 29.03.2021): https://arxiv.org/abs/1312.4400
• 21 Shen J, Zhang CJP, Jiang B. et al. Artificial Intelligence Versus Clinicians in Disease Diagnosis: Systematic Review. JMIR Med Inform 2019; 7: e10010 DOI: 10.2196/10010.
• 22 Olczak J, Fahlberg N, Maki A. et al. Artificial intelligence for analyzing orthopedic trauma radiographs. Acta Orthop 2017; 88: 581-586 DOI: 10.1080/17453674.2017.1344459.
• 23 Gan K, Xu D, Lin Y. et al. Artificial intelligence detection of distal radius fractures: a comparison between the convolutional neural network and professional assessments. Acta Orthop 2019; 90: 394-400 DOI: 10.1080/17453674.2019.1600125.
• 24 Lindsey R, Daluiski A, Chopra S. et al. Deep neural network improves fracture detection by clinicians. Proc Natl Acad Sci U S A 2018; 115: 11591-11596 DOI: 10.1073/pnas.1806905115.
• 25 Langerhuizen DWG, Janssen SJ, Mallee WH. et al. What Are the Applications and Limitations of Artificial Intelligence for Fracture Detection and Classification in Orthopaedic Trauma Imaging? A Systematic Review. Clin Orthop Relat Res 2019; 477: 2482-2491 DOI: 10.1097/CORR.0000000000000848.
• 26 Pinto A, Berritto D, Russo A. et al. Traumatic fractures in adults: missed diagnosis on plain radiographs in the Emergency Department. Acta Biomed 2018; 89: 111-123 DOI: 10.23750/abm.v89i1-S.7015.
• 27 Goddard P, Leslie A, Jones A. et al. Error in radiology. Br J Radiol 2001; 74: 949-951 DOI: 10.1259/bjr.74.886.740949.
• 28 Pohlemann T, Tosounidis G, Bircher M. et al. The German Multicentre Pelvis Registry: a template for an European Expert Network?. Injury 2007; 38: 416-423 DOI: 10.1016/j.injury.2007.01.007.
• 29 Riouallon G, Sebaaly A, Upex P. et al. A New, Easy, Fast, and Reliable Method to Correctly Classify Acetabular Fractures According to the Letournel System. JB JS Open Access 2018; 3: e0032 DOI: 10.2106/JBJS.OA.17.00032.
• 30 Ohashi K, El-Khoury GY, Abu-Zahra KW. et al. Interobserver agreement for Letournel acetabular fracture classification with multidetector CT: are standard Judet radiographs necessary?. Radiology 2006; 241: 386-391 DOI: 10.1148/radiol.2412050960.