Artificial intelligence for diagnosing neoplasia on digital cholangioscopy: development and multicenter validation of a convolutional neural network model

Abstract

Background We aimed to develop a convolutional neural network (CNN) model for detecting neoplastic lesions during real-time digital single-operator cholangioscopy (DSOC) and to clinically validate the model through comparisons with DSOC expert and nonexpert endoscopists.

Methods In this two-stage study, we first developed and validated CNN1. Then, we performed a multicenter diagnostic trial to compare four DSOC experts and nonexperts against an improved model (CNN2). Lesions were classified into neoplastic and non-neoplastic in accordance with Carlos Robles-Medranda (CRM) and Mendoza disaggregated criteria. The final diagnosis of neoplasia was based on histopathology and 12-month follow-up outcomes.

Results In stage I, CNN2 achieved a mean average precision of 0.88, an intersection over the union value of 83.24 %, and a total loss of 0.0975. For clinical validation, a total of 170 videos from newly included patients were analyzed with the CNN2. Half of cases (50 %) had neoplastic lesions. This model achieved significant accuracy values for neoplastic diagnosis, with a 90.5 % sensitivity, 68.2 % specificity, and 74.0 % and 87.8 % positive and negative predictive values, respectively. The CNN2 model outperformed nonexpert #2 (area under the receiver operating characteristic curve [AUC]-CRM 0.657 vs. AUC-CNN2 0.794, P < 0.05; AUC-Mendoza 0.582 vs. AUC-CNN2 0.794, P < 0.05), nonexpert #4 (AUC-CRM 0.683 vs. AUC-CNN2 0.791, P < 0.05), and expert #4 (AUC-CRM 0.755 vs. AUC-CNN2 0.848, P < 0.05; AUC-Mendoza 0.753 vs. AUC-CNN2 0.848, P < 0.05).

Conclusions The proposed CNN model distinguished neoplastic bile duct lesions with good accuracy and outperformed two nonexpert and one expert endoscopist.

• References

• 1 Navaneethan U, Njei B, Lourdusamy V. et al. Comparative effectiveness of biliary brush cytology and intraductal biopsy for detection of malignant biliary strictures: a systematic review and meta-analysis. Gastrointest Endosc 2015; 81: 168-176
• 2 Yoon WJ, Brugge WR. Endoscopic evaluation of bile duct strictures. Gastrointest Endosc Clin N Am 2013; 23: 277-293
• 3 Robles-Medranda C, Oleas R, Sánchez-Carriel M. et al. Vascularity can distinguish neoplastic from non-neoplastic bile duct lesions during digital single-operator cholangioscopy. Gastrointest Endosc 2021; 93: 935-941
• 4 Chung HG, Chang JI, Lee KH. et al. Comparison of EUS and ERCP-guided tissue sampling in suspected biliary stricture. PLoS One 2021; 16: 1-12
• 5 Robles-Medranda C, Valero M, Soria-Alcivar M. et al. Reliability and accuracy of a novel classification system using peroral cholangioscopy for the diagnosis of bile duct lesions. Endoscopy 2018; 50: 1059-1070
• 6 Gerges C, Beyna T, Tang RSY. et al. Digital single-operator peroral cholangioscopy-guided biopsy sampling versus ERCP-guided brushing for indeterminate biliary strictures: a prospective, randomized, multicenter trial (with video). Gastrointest Endosc 2020; 91: 1105-1013
• 7 Fukuda Y, Tsuyuguchi T, Sakai Y. et al. Diagnostic utility of peroral cholangioscopy for various bile-duct lesions. Gastrointest Endosc 2005; 62: 374-382
• 8 Kahaleh M, Gaidhane M, Shahid HM. et al. Digital single-operator cholangioscopy interobserver study using a new classification: the Mendoza Classification (with video). Gastrointest Endosc 2022; 95: 319-326
• 9 de Oliveira PVAG, de Moura DTH, Ribeiro IB. et al. Efficacy of digital single-operator cholangioscopy in the visual interpretation of indeterminate biliary strictures: a systematic review and meta-analysis. Surg Endosc 2020; 34: 3321-3329
• 10 Sethi A, Tyberg A, Slivka A. et al. Digital single-operator cholangioscopy (DSOC) improves interobserver agreement (IOA) and accuracy for evaluation of indeterminate biliary strictures: the Monaco Classification. J Clin Gastroenterol 2022; 56: e94-e97
• 11 Kahaleh M, Raijman I, Gaidhane M. et al. Digital cholangioscopic interpretation: when North meets the South. Dig Dis Sci 2021; 67: 1345-1351
• 12 Sarvamangala DR, Kulkarni Raghavendra V. Convolutional neural networks in medical image understanding: a survey. Evol Intell 2022; 15: 1-22
• 13 Chan HP, Samala RK, Hadjiiski LM. et al. Deep learning in medical image analysis. Adv Exp Med Biol 2020; 1213: 3-21
• 14 le Berre C, Sandborn WJ, Aridhi S. et al. Application of artificial intelligence to gastroenterology and hepatology. Gastroenterology 2020; 158: 76-94
• 15 Pereira P, Mascarenhas M, Ribeiro T. et al. Automatic detection of tumor vessels in indeterminate biliary strictures in digital single-operator cholangioscopy. Endosc Int Open 2022; 10: E262-268
• 16 Saraiva MM, Ribeiro T, Ferreira JPS. et al. Artificial intelligence for automatic diagnosis of biliary stricture malignancy status in single-operator cholangioscopy: a pilot study. Gastrointest Endosc 2022; 95: 339-348
• 17 Kohl M. CRAN package MKmisc. Accessed 18 April 2022. https://cran.r-project.org/web/packages/MKmisc/index.html
• 18 Shah RJ, Raijman I, Brauer B. et al. Performance of a fully disposable, digital, single-operator cholangiopancreatoscope. Endoscopy 2017; 49: 651-658