Use of Artificial Intelligence in Nononcologic Interventional Radiology: Current State and Future Directions

Abstract

The future of radiology is disproportionately linked to the applications of artificial intelligence (AI). Recent exponential advancements in AI are already beginning to augment the clinical practice of radiology. Driven by a paucity of review articles in the area, this article aims to discuss applications of AI in nononcologic IR across procedural planning, execution, and follow-up along with a discussion on the future directions of the field. Applications in vascular imaging, radiomics, touchless software interactions, robotics, natural language processing, postprocedural outcome prediction, device navigation, and image acquisition are included. Familiarity with AI study analysis will help open the current “black box” of AI research and help bridge the gap between the research laboratory and clinical practice.

Keywords

artificial intelligence - machine learning - radiomics - deep learning - interventional radiology

IRB

This study does not involve human subjects and is IRB-exempt.

Disclaimer

Financial remuneration was not provided to authors and family members related to the subject of this article. J.C. reports grant support from the Society of Interventional Oncology, Guerbet Pharmaceuticals, Philips Healthcare, Boston Scientific, Yale Center for Clinical Investigation, and the NIH R01CA206180 outside the submitted work.

Publication History

Received: 03 November 2020

Accepted: 28 January 2021

Article published online:
17 July 2021

• References

• 1 Artificial Intelligence and Machine Learning in Software as a Medical Device (SaMD). Accessed October 20, 2020 at: https://www.fda.gov/medical-devices/software-medical-device-samd/artificial-intelligence-and-machine-learning-software-medical-device#whatis
• 2 Sailer AM, Tipaldi MA, Krokidis M. AI in interventional radiology: there is momentum for high-quality data registries. Cardiovasc Intervent Radiol 2019; 42 (08) 1208-1209
• 3 Xu C, Jackson SA. Machine learning and complex biological data. Genome Biol 2019; 20 (01) 76
• 4 Shah P, Kendall F, Khozin S. et al. Artificial intelligence and machine learning in clinical development: a translational perspective. NPJ Digit Med 2019; 2: 69
• 5 Hendee WR, Becker GJ, Borgstede JP. et al. Addressing overutilization in medical imaging. Radiology 2010; 257 (01) 240-245
• 6 Lakhani P, Prater AB, Hutson RK. et al. Machine learning in radiology: applications beyond image interpretation. J Am Coll Radiol 2018; 15 (02) 350-359
• 7 Richardson ML, Garwood ER, Lee Y. et al. Noninterpretive uses of artificial intelligence in radiology. Acad Radiol 2020:S1076-6332(20)30039-8
• 8 Abajian A, Murali N, Savic LJ. et al. Predicting treatment response to intra-arterial therapies for hepatocellular carcinoma with the use of supervised machine learning-an artificial intelligence concept. J Vasc Interv Radiol 2018; 29 (06) 850-857.e1
• 9 Letzen B, Wang CJ, Chapiro J. The role of artificial intelligence in interventional oncology: a primer. J Vasc Interv Radiol 2019; 30 (01) 38-41.e1
• 10 Murali N, Kucukkaya A, Petukhova A, Onofrey J, Chapiro J. Supervised machine learning in oncology: a clinician's guide. Dig Dis Interv 2020; 4 (01) 73-81
• 11 Riyahi S, Choi W, Liu CJ. et al. Quantifying local tumor morphological changes with Jacobian map for prediction of pathologic tumor response to chemo-radiotherapy in locally advanced esophageal cancer. Phys Med Biol 2018; 63 (14) 145020
• 12 Iezzi R, Goldberg SN, Merlino B, Posa A, Valentini V, Manfredi R. Artificial intelligence in interventional radiology: a literature review and future perspectives. J Oncol 2019; 2019: 6153041
• 13 Meek RD, Lungren MP, Gichoya JW. Machine learning for the interventional radiologist. AJR Am J Roentgenol 2019; 213 (04) 782-784
• 14 Handelman GS, Kok HK, Chandra RV. et al. Peering into the black box of artificial intelligence: evaluation metrics of machine learning methods. AJR Am J Roentgenol 2019; 212 (01) 38-43
• 15 Samuel AL. Some studies in machine learning using the game of checkers. IBM J Res Develop 1959; 3 (03) 210-229
• 16 Dayhoff JE, DeLeo JM. Artificial neural networks: opening the black box. Cancer 2001; 91 (8, Suppl): 1615-1635
• 17 Salman K, Hossein R, Syed Afaq Ali S, Mohammed B, Gerard M, Sven D. A Guide to Convolutional Neural Networks for Computer Vision. Morgan & Claypool: 2018
• 18 Castellino RA. Computer aided detection (CAD): an overview. Cancer Imaging 2005; 5: 17-19
• 19 Liu Z, Yang M, Wang X. et al. Entity recognition from clinical texts via recurrent neural network. BMC Med Inform Decis Mak 2017; 17 (Suppl. 02) 67
• 20 Mehrabi N, Morstatter F, Saxena N, Lerman K, Galstyan A. A survey on bias and fairness in machine learning. ArXiv 2019; abs/1908.09635
• 21 Vayena E, Dzenowagis J, Brownstein JS, Sheikh A. Policy implications of big data in the health sector. Bull World Health Organ 2018; 96 (01) 66-68
• 22 Kumar V, Gu Y, Basu S. et al. Radiomics: the process and the challenges. Magn Reson Imaging 2012; 30 (09) 1234-1248
• 23 Verma V, Simone II CB, Krishnan S, Lin SH, Yang J, Hahn SM. The rise of radiomics and implications for oncologic management. J Natl Cancer Inst 2017;109(07):
• 24 Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data. Radiology 2016; 278 (02) 563-577
• 25 Clarke LP, Nordstrom RJ, Zhang H. et al. The Quantitative Imaging Network: NCI's historical perspective and planned goals. Transl Oncol 2014; 7 (01) 1-4
• 26 Mewes A, Hensen B, Wacker F, Hansen C. Touchless interaction with software in interventional radiology and surgery: a systematic literature review. Int J CARS 2017; 12 (02) 291-305
• 27 Seals K, Al-Hakim R, Mulligan P. et al. 03:45 PM Abstract No. 38 The development of a machine learning smart speaker application for device sizing in interventional radiology. J Vasc Interv Radiol 2019; 30 (03) S20
• 28 Schwarz LA, Bigdelou A, Navab N. Learning gestures for customizable human-computer interaction in the operating room. Paper presented at: Medical Image Computing and Computer-Assisted Intervention – MICCAI. 2011 Berlin, Heidelberg
• 29 Bigdelou A, Schwarz L, Navab N. An adaptive solution for intra-operative gesture-based human-machine interaction. Proceedings of the 2012 ACM international conference on Intelligent User Interfaces. 2012 Lisbon, Portugal
• 30 Kotwicz Herniczek S, Lasso A, Ungi T, Fichtinger G. Feasibility of a Touch-Free User Interface for Ultrasound Snapshot-Guided Nephrostomy. Vol 9036: SPIE; 2014
• 31 Tang A, Tam R, Cadrin-Chênevert A. et al; Canadian Association of Radiologists (CAR) Artificial Intelligence Working Group. Canadian Association of Radiologists white paper on artificial intelligence in radiology. Can Assoc Radiol J 2018; 69 (02) 120-135
• 32 Suelze B, Agten R, Bertrand PB. et al. Waving at the heart: implementation of a Kinect-based real-time interactive control system for viewing cineangiogram loops during cardiac catheterization procedures. Comput Cardiol 2013; 2013: 2013
• 33 Nishida N, Nakayama H. Multimodal gesture recognition using multi-stream recurrent neural network. Revised Selected Papers of the 7th Pacific-Rim Symposium on Image and Video Technology. Vol 9431. 2015 ; Auckland, New Zealand
• 34 Seals K, Dubin B, Leonards L. et al. Utilization of deep learning techniques to assist clinicians in diagnostic and interventional radiology: development of a virtual radiology assistant. J Vasc Interv Radiol 2017; 28 (02) S153
• 35 Wongvibulsin S, Wu KC, Zeger SL. Clinical risk prediction with random forests for survival, longitudinal, and multivariate (RF-SLAM) data analysis. BMC Med Res Methodol 2019; 20 (01) 1
• 36 Sinha I, Aluthge DP, Chen ES, Sarkar IN, Ahn SH. Machine learning offers exciting potential for predicting postprocedural outcomes: a framework for developing random forest models in IR. J Vasc Interv Radiol 2020; 31 (06) 1018-1024.e4
• 37 Ross EG, Shah NH, Dalman RL, Nead KT, Cooke JP, Leeper NJ. The use of machine learning for the identification of peripheral artery disease and future mortality risk. J Vasc Surg 2016; 64 (05) 1515-1522.e3
• 38 Asadi H, Kok HK, Looby S, Brennan P, O'Hare A, Thornton J. Outcomes and complications after endovascular treatment of brain arteriovenous malformations: a prognostication attempt using artificial intelligence. World Neurosurg 2016; 96: 562-569.e1
• 39 Bentley P, Ganesalingam J, Carlton Jones AL. et al. Prediction of stroke thrombolysis outcome using CT brain machine learning. Neuroimage Clin 2014; 4: 635-640
• 40 Alawieh A, Zaraket F, Alawieh MB, Chatterjee AR, Spiotta A. Using machine learning to optimize selection of elderly patients for endovascular thrombectomy. J Neurointerv Surg 2019; 11 (08) 847-851
• 41 Auloge P, Cazzato RL, Ramamurthy N. et al. Augmented reality and artificial intelligence-based navigation during percutaneous vertebroplasty: a pilot randomised clinical trial. Eur Spine J 2020; 29 (07) 1580-1589
• 42 Fritz J, U-Thainual P, Ungi T. et al. Augmented reality visualisation using an image overlay system for MR-guided interventions: technical performance of spine injection procedures in human cadavers at 1.5 Tesla. Eur Radiol 2013; 23 (01) 235-245
• 43 Fritz J, U-Thainual P, Ungi T. et al. MR-guided vertebroplasty with augmented reality image overlay navigation. Cardiovasc Intervent Radiol 2014; 37 (06) 1589-1596
• 44 Tacher V, de Baere T. Robotic assistance in interventional radiology: dream or reality?. Eur Radiol 2020; 30 (02) 925-926
• 45 Cleary K, Melzer A, Watson V, Kronreif G, Stoianovici D. Interventional robotic systems: applications and technology state-of-the-art. Minim Invasive Ther Allied Technol 2006; 15 (02) 101-113
• 46 Fagogenis G, Mencattelli M, Machaidze Z. et al. Autonomous robotic intracardiac catheter navigation using haptic vision. Sci Robot 2019; 4 (29) eaaw1977
• 47 Chen AI, Balter ML, Maguire TJ, Yarmush ML. Deep learning robotic guidance for autonomous vascular access. Nature Machine Intelligence. 2020; 2 (02) 104-115
• 48 Chen KT, Gong E, de Carvalho Macruz FB. et al. Ultra-low-dose ¹⁸F-florbetaben amyloid PET imaging using deep learning with multi-contrast MRI inputs. Radiology 2019; 290 (03) 649-656
• 49 Gong E, Pauly JM, Wintermark M, Zaharchuk G. Deep learning enables reduced gadolinium dose for contrast-enhanced brain MRI. J Magn Reson Imaging 2018; 48 (02) 330-340
• 50 Chen H, Zhang Y, Zhang W. et al. Low-dose CT via convolutional neural network. Biomed Opt Express 2017; 8 (02) 679-694
• 51 El-Shallaly GE, Mohammed B, Muhtaseb MS, Hamouda AH, Nassar AH. Voice recognition interfaces (VRI) optimize the utilization of theatre staff and time during laparoscopic cholecystectomy. Minim Invasive Ther Allied Technol 2005; 14 (06) 369-371
• 52 Merali N, Veeramootoo D, Singh S. Eye-tracking technology in surgical training. J Invest Surg 2019; 32 (07) 587-593
• 53 Pattharanitima P, Tasanarong A. Pharmacological strategies to prevent contrast-induced acute kidney injury. BioMed Res Int 2014; 2014: 236930
• 54 Dauvin A, Donado C, Bachtiger P. et al. Machine learning can accurately predict pre-admission baseline hemoglobin and creatinine in intensive care patients. NPJ Digit Med 2019; 2: 116
• 55 Chapiro J. The role of artificial intelligence. Endovascular Today 2020; 19 (10) 78-79
• 56 DeCamp M, Lindvall C. Latent bias and the implementation of artificial intelligence in medicine. J Am Med Inform Assoc 2020; 27 (12) 2020-2023
• 57 Hung AJ, Chen J, Che Z. et al. Utilizing machine learning and automated performance metrics to evaluate robot-assisted radical prostatectomy performance and predict outcomes. J Endourol 2018; 32 (05) 438-444
• 58 Orme NM, Rihal CS, Gulati R. et al. Occupational health hazards of working in the interventional laboratory: a multisite case control study of physicians and allied staff. J Am Coll Cardiol 2015; 65 (08) 820-826