Diagnostic performance of artificial intelligence to identify deeply invasive colorectal cancer on non-magnified plain endoscopic images

Abstract

Background and study aims Colorectal cancers (CRC) with deep submucosal invasion (T1b) could be metastatic lesions. However, endoscopic images of T1b CRC resemble those of mucosal CRCs (Tis) or with superficial invasion (T1a). The aim of this study was to develop an automatic computer-aided diagnosis (CAD) system to identify T1b CRC based on plain endoscopic images.

Patients and methods In two hospitals, 1839 non-magnified plain endoscopic images from 313 CRCs (Tis 134, T1a 46, T1b 56, beyond T1b 37) with sessile morphology were extracted for training. A CAD system was trained with the data augmented by rotation, saturation, resizing and exposure adjustment. Diagnostic performance was assessed using another dataset including 44 CRCs (Tis 23, T1b 21) from a third hospital. CAD generated a probability level for T1b diagnosis for each image, and > 95 % of probability level was defined as T1b. Lesions with at least one image with a probability level > 0.95 were regarded as T1b. Primary outcome is specificity. Six physicians separately read the same testing dataset.

Results Specificity was 87 % (95 % confidence interval: 66–97) for CAD, 100 % (85–100) for Expert 1, 96 % (78–100) for Expert 2, 61 % (39–80) for both gastroenterology trainees, 48 % (27–69) for Novice 1 and 22 % (7–44) for Novice 2. Significant differences were observed between CAD and both novices (P = 0.013, P = 0.0003). Other diagnostic values of CAD were slightly lower than of the two experts.

Conclusions Specificity of CAD was superior to novices and possibly to gastroenterology trainees but slightly inferior to experts.

Publication History

Received: 23 April 2020

Accepted: 24 June 2020

Article published online:
22 September 2020

• References

• 1 Japanese Society for Cancer of the Colon and Rectum. Japanese Classification of Colorectal, Appendiceal, and Anal Carcinoma: the 3d English Edition [Secondary Publication]. J Anus Rectum Colon 2019; 3: 175-195
• 2 Pimentel-Nunes P, Dinis-Ribeiro M, Ponchon T. et al. Endoscopic submucosal dissection: European Society of Gastrointestinal Endoscopy (ESGE) guideline. Endoscopy 2015; 47: 829-854
• 3 Draganov P, Wang A, Othman M. et al. AGA Institute Clinical Practice Update: Endoscopic Submucosal Dissection in the United States. Clin Gastroenterol Hepatol 2019; 17: 16-25
• 4 Saitoh Y, Obara T, Watari J. et al. Invasion depth diagnosis of depressed type early colorectal cancers by combined use of videoendoscopy and chromoendoscopy. Gastrointest Endosc 1998; 48: 362-370
• 5 Horie H, Togashi K, Kawamura YJ. et al. Colonoscopic stigmata of 1 mm or deeper submucosal invasion in colorectal cancer. Dis Colon Rectum 2008; 1529-1534
• 6 Backes Y, Schwartz MP, Ter Borg F. et al. Multicentre prospective evaluation of real-time optical diagnosis of T1 colorectal cancer in large non-pedunculated colorectal polyps using narrow band imaging (the OPTICAL study). Gut 2019; 68: 271-279
• 7 Puig I, López-Cerón M, Arnau A. et al. Accuracy of the narrow-band imaging international colorectal endoscopic classification system in identification of deep invasion in colorectal polyps. Gastroenterol 2019; 156: 75-87
• 8 Mukae M, Kobayashi K, Sada M. et al. Diagnostic performance of EUS for evaluating the invasion depth of early colorectal cancers. Gastrointest Endosc 2015; 81: 682-690
• 9 Kudo S, Tamura S, Nakajima T. et al. Diagnosis of colorectal tumorous lesions by magnifying endoscopy. Gastrointest Endosc 1996; 44: 8-14
• 10 Matsuda T, Fujii T, Saito TY. et al. Efficacy of the invasive/non-invasive pattern by magnifying chromoendoscopy to estimate the depth of invasion of early colorectal neoplasms. Am J Gastroenterol 2008; 103: 2700-6270
• 11 Kudo SE, Mori Y, Misawa M. et al. Artificial intelligence and colonoscopy: Current status and future perspectives. Dig Endosc 2019; 31: 363-371
• 12 Togashi K. Applications of artificial intelligence to endoscopy practice: The view from Japan Digestive Disease Week 2018. Dig Endosc 2019; 31: 270-272
• 13 Misawa M, Kudo S, Mori Y. et al. Artificial intelligence-assisted polyp detection for colonoscopy: initial experience. Gastroenterology 2018; 154: 2027-2029
• 14 Urban G, Tripathi P, Alkayali T. et al. Deep learning localizes and identifies polyps in real time with 96% accuracy in screening colonoscopy. Gastroenterology 2018; 155: 1069-1078
• 15 Wang P, Berzin TM, Brown JRG. et al. Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study. Gut 2019; 68: 1813-1819
• 16 Takeda K, Kudo SE, Mori Y. et al. Accuracy of diagnosing invasive colorectal cancer using computer-aided endocytoscopy. Endoscopy 2017; 49: 798-802
• 17 Ito N, Kawahira H, Nakashima H. et al. Endoscopic diagnostic support system for cT1b colorectal cancer using deep learning. Oncology 2019; 96: 44-50
• 18 Lui T, Wong K, Mak L. et al. Endoscopic prediction of deeply submucosal invasive carcinoma with use of artificial intelligence. Endosc Int Open 2019; 7: E514-E520
• 19 Paris endoscopic classification of superficial neoplastic lesions: esophagus, stomach, and colon: November 30 to December 1, 2002. Gastrointest Endosc 2003; 58 (Suppl. 06) S3-S43
• 20 Kaiming H, Zhang X, Ren S. et al. “Deep residual learning for image recognition.” In Proceedings of the IEEE conference on computer vision and pattern recognition. 2016: 770-778 Available from (Accessed February 12, 2020): http://openaccess.thecvf.com/content_cvpr_2016/papers/He_Deep_Residual_Learning_CVPR_2016_paper.pdf
• 21 Guo Z, Zhang R, Li Q. et al. reduce false-positive rate by active learning for automatic polyp detection in colonoscopy videos. Proc IEEE International Symposium on Biomedical Imaging (ISBI'20) 2020; 01: 1655-1658
• 22 Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. Proc ECCV; 2014 Available from (Accessed February 12, 2020): https://cs.nyu.edu/~fergus/papers/zeilerECCV2014.pdf