Computer-assisted diagnosis of early esophageal squamous cell carcinoma using narrow-band imaging magnifying endoscopy

Abstract

Background We developed a computer-assisted diagnosis model to evaluate the feasibility of automated classification of intrapapillary capillary loops (IPCLs) to improve the detection of esophageal squamous cell carcinoma (ESCC).

Methods We recruited patients who underwent magnifying endoscopy with narrow-band imaging for evaluation of a suspicious esophageal condition. Case images were evaluated to establish a gold standard IPCL classification according to the endoscopic diagnosis and histological findings. A double-labeling fully convolutional network (FCN) was developed for image segmentation. Diagnostic performance of the model was compared with that of endoscopists grouped according to years of experience (senior > 15 years; mid level 10 – 15 years; junior 5 – 10 years).

Results Of the 1383 lesions in the study, the mean accuracies of IPCL classification were 92.0 %, 82.0 %, and 73.3 %, for the senior, mid level, and junior groups, respectively. The mean diagnostic accuracy of the model was 89.2 % and 93.0 % at the lesion and pixel levels, respectively. The interobserver agreement between the model and the gold standard was substantial (kappa value, 0.719). The accuracy of the model for inflammatory lesions (92.5 %) was superior to that of the mid level (88.1 %) and junior (86.3 %) groups (P < 0.001). For malignant lesions, the accuracy of the model (B1, 87.6 %; B2, 93.9 %) was significantly higher than that of the mid level (B1, 79.1 %; B2, 90.0 %) and junior (B1, 69.2 %; B2, 79.3 %) groups (P < 0.001).

Conclusions Double-labeling FCN automated IPCL recognition was feasible and could facilitate early detection of ESCC.

^* These authors contributed equally to this work.

• References

• 1 Fitzmaurice C, Dicker D, Pain A. et al. The global burden of cancer 2013. JAMA Oncol 2015; 1: 505-527
• 2 Arnold M, Soerjomataram I, Ferlay J. et al. Global incidence of oesophageal cancer by histological subtype in 2012. Gut 2015; 64: 381-387
• 3 Zeng H, Zheng R, Guo Y. et al. Cancer survival in China, 2003 – 2005: a population-based study. Int J Cancer 2015; 136: 1921-1930
• 4 Ciocirlan M, Lapalus MG, Hervieu V. et al. Endoscopic mucosal resection for squamous premalignant and early malignant lesions of the esophagus. Endoscopy 2007; 39: 24-29
• 5 Inoue H, Kaga M, Ikeda H. et al. Magnification endoscopy in esophageal squamous cell carcinoma: a review of the intrapapillary capillary loop classification. Ann Gastroenterol 2015; 28: 41-48
• 6 Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. In: Pereira F, Burges CJC, Bottou L, Weinberger KQ. eds. Advances in Neural Information Processing Systems 25. Lake Tahoe, Nevada, USA: 2012. Available from: https://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf
• 7 Szegedy C, Liu W, Jia YQ. et al. Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Boston, Massachusetts, USA: 2015. Available from: https://ieeexplore.ieee.org/document/7298594/
• 8 Liedlgruber M, Uhl A. Computer-aided decision support systems for endoscopy in the gastrointestinal tract: a review. IEEE Rev Biomed Eng 2011; 4: 73-88
• 9 Tischendorf JJ, Gross S, Winograd R. et al. Computer-aided classification of colorectal polyps based on vascular patterns: a pilot study. Endoscopy 2010; 42: 203-207
• 10 Kominami Y, Yoshida S, Tanaka S. et al. Computer-aided diagnosis of colorectal polyp histology by using a real-time image recognition system and narrow-band imaging magnifying colonoscopy. Gastrointest Endosc 2016; 83: 643-649
• 11 Misawa M, Kudo SE, Mori Y. et al. Characterization of colorectal lesions using a computer-aided diagnostic system for narrow-band imaging endocytoscopy. Gastroenterology 2016; 150: 1531-1532
• 12 Mori Y, Kudo SE, Berzin TM. et al. Computer-aided diagnosis for colonoscopy. Endoscopy 2017; 49: 813-819
• 13 Misawa M, Kudo SE, Mori Y. et al. Accuracy of computer-aided diagnosis based on narrow-band imaging endocytoscopy for diagnosing colorectal lesions: comparison with experts. Int J Comput Assist Radiol Surg 2017; 12: 757-766
• 14 Byrne MF, Chapados N, Soudan F. et al. Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut 2017; DOI: 10.1136/gutjnl-2017-314547.
• 15 Van der Sommen F, Zinger S, Curvers WL. et al. Computer-aided detection of early neoplastic lesions in Barrett’s esophagus. Endoscopy 2016; 48: 617-624
• 16 Xue DX, Zhang R, Zhu RS. Microvascular morphological type recognition using trainable feature extractor. Proceedings of the 2015 IEEE International Symposium on Bioelectronics and Bioinformatics (ISBB). Beijing, China: IEEE; 2015: 67-70
• 17 Xue DX, Zhang R, Feng H. et al. CNN-SVM for microvascular morphological type recognition with data augmentation. J Med Biol Eng 2016; 36: 755-764
• 18 Xue DX, Zhang R, Zhao YY. et al. Fully convolutional networks with double-label for esophageal cancer image segmentation by self-transfer learning. Proceedings of the Ninth International Conference on Digital Image Processing (ICDIP 2017), 104202D. Hong Kong, China: International Society for Optics and Photonics; 2017
• 19 Schlemper RJ, Riddell RH, Kato Y. et al. The Vienna classification of gastrointestinal epithelial neoplasia. Gut 2000; 47: 251-255
• 20 Dixon MF. Gastrointestinal epithelial neoplasia: Vienna revisited. Gut 2002; 51: 130-131
• 21 Oyama T, Ishihara R, Takeuchi M. et al. Usefulness of Japan Esophageal Society classification of magnified endoscopy for the diagnosis of superficial esophageal squamous cell carcinoma. Gastrointest Endosc 2012; 75: AB456
• 22 Minami H, Isomoto H, Inoue H. et al. Significance of background coloration in endoscopic detection of early esophageal squamous cell carcinoma. Digestion 2014; 89: 6-11
• 23 Japan Esophageal Society. Japanese classification of esophageal cancer, tenth edition: parts II and III. Esophagus 2009; 6: 71-94
• 24 Shelhamer E, Long J, Darrell T. Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 2017; 39: 640-651
• 25 Gwang HK, Su JK, Moon WL. et al. A new magnifying endoscopic classification for superficial esophageal squamous cell carcinoma. Gastrointest Endosc 2017; 85: AB571
• 26 Quang T, Schwarz RA, Dawsey SW. et al. A tablet-interfaced high-resolution microendoscope with automated image interpretation for real-time evaluation of esophageal squamous cell neoplasia. Gastrointest Endosc 2016; 84: 834-841
• 27 Deng J, Dong W, Socher R. et al. ImageNet: a large-scale hierarchical image database. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2009. Miami, Florida, USA: 2009. Available from: https://ieeexplore.ieee.org/document/5206848/
• 28 Byrne MF, Shahidi N. Will computer-aided detection and diagnosis revolutionize colonoscopy?. Gastroenterology 2017; 153: 1460-1464
• 29 East JE, Vleugels JL, Roelandt P. et al. Advanced endoscopic imaging: European Society of Gastrointestinal Endoscopy (ESGE) Technology Review. Endoscopy 2016; 48: 1029-1045