Artificial intelligence-based diagnosis of abnormalities in small-bowel capsule endoscopy

Abstract

Background Further development of deep learning-based artificial intelligence (AI) technology to automatically diagnose multiple abnormalities in small-bowel capsule endoscopy (SBCE) videos is necessary. We aimed to develop an AI model, to compare its diagnostic performance with doctors of different experience levels, and to further evaluate its auxiliary role for doctors in diagnosing multiple abnormalities in SBCE videos.

Methods The AI model was trained using 280 426 images from 2565 patients, and the diagnostic performance was validated in 240 videos.

Results The sensitivity of the AI model for red spots, inflammation, blood content, vascular lesions, protruding lesions, parasites, diverticulum, and normal variants was 97.8 %, 96.1 %, 96.1 %, 94.7 %, 95.6 %, 100 %, 100 %, and 96.4 %, respectively. The specificity was 86.0 %, 75.3 %, 87.3 %, 77.8 %, 67.7 %, 97.5 %, 91.2 %, and 81.3 %, respectively. The accuracy was 95.0 %, 88.8 %, 89.2 %, 79.2 %, 80.8 %, 97.5 %, 91.3 %, and 93.3 %, respectively. For junior doctors, the assistance of the AI model increased the overall accuracy from 85.5 % to 97.9 % (P  < 0.001, Bonferroni corrected), comparable to that of experts (96.6 %, P > 0.0125, Bonferroni corrected).

Conclusions This well-trained AI diagnostic model automatically diagnosed multiple small-bowel abnormalities simultaneously based on video-level recognition, with potential as an excellent auxiliary system for less-experienced endoscopists.

^* These authors contributed equally to this work.

Publication History

Received: 30 November 2021

Accepted after revision: 12 May 2022

Article published online:
05 August 2022

• References

• 1 Chetcuti Zammit S, Sidhu R. Capsule endoscopy – recent developments and future directions. Expert Rev Gastroenterol Hepatol 2021; 15: 127-137
• 2 Leenhardt R, Souchaud M, Houist G. et al. A neural network-based algorithm for assessing the cleanliness of small bowel during capsule endoscopy. Endoscopy 2021; 53: 932-936
• 3 Dray X, Iakovidis D, Houdeville C. et al. Artificial intelligence in small bowel capsule endoscopy – current status, challenges and future promise. J Gastroenterol Hepatol 2021; 36: 12-19
• 4 Noya F, Alvarez-Gonzalez MA, Benitez R. Automated angiodysplasia detection from wireless capsule endoscopy. Annu Int Conf IEEE Eng Med Biol Soc 2017; 2017: 3158-3161
• 5 Leenhardt R, Vasseur P, Li C. et al. A neural network algorithm for detection of GI angiectasia during small-bowel capsule endoscopy. Gastrointest Endosc 2019; 89: 189-194
• 6 Tsuboi A, Oka S, Aoyama K. et al. Artificial intelligence using a convolutional neural network for automatic detection of small-bowel angioectasia in capsule endoscopy images. Dig Endosc 2020; 32: 382-390
• 7 Fan S, Xu L, Fan Y. et al. Computer-aided detection of small intestinal ulcer and erosion in wireless capsule endoscopy images. Phys Med Biol 2018; 63: 165001
• 8 Aoki T, Yamada A, Aoyama K. et al. Automatic detection of erosions and ulcerations in wireless capsule endoscopy images based on a deep convolutional neural network. Gastrointest Endosc 2019; 89: 357-363
• 9 Wang S, Xing Y, Zhang L. et al. A systematic evaluation and optimization of automatic detection of ulcers in wireless capsule endoscopy on a large dataset using deep convolutional neural networks. Phys Med Biol 2019; 64: 235014
• 10 Klang E, Barash Y, Margalit RY. et al. Deep learning algorithms for automated detection of Crohn’s disease ulcers by video capsule endoscopy. Gastrointest Endosc 2020; 91: 606-613
• 11 Ding Z, Shi H, Zhang H. et al. Gastroenterologist-level identification of small-bowel diseases and normal variants by capsule endoscopy using a deep-learning model. Gastroenterology 2019; 157: 1044-1054
• 12 Weigt J, Repici A, Antonelli G. et al. Performance of a new integrated computer-assisted system (CADe/CADx) for detection and characterization of colorectal neoplasia. Endoscopy 2022; 54: 180-184
• 13 Toyoshima N, Saito Y, Yamada M. et al. Early colorectal lesion (depressed type) detected using artificial intelligence. Endoscopy 2022; DOI: 10.1055/a-1732-7197.
• 14 Pan J, Xia J, Jiang B. et al. Real-time identification of gastric lesions and anatomical landmarks by artificial intelligence during magnetically controlled capsule endoscopy. Endoscopy 2022; DOI: 10.1055/a-1724-6958.
• 15 Kudo SE, Misawa M, Mori Y. et al. Identification of a small, depressed type of colorectal invasive cancer by an artificial intelligence-assisted detection system. Endoscopy 2021; DOI: 10.1055/a-1704-8103.
• 16 Otani K, Nakada A, Kurose Y. et al. Automatic detection of different types of small-bowel lesions on capsule endoscopy images using a newly developed deep convolutional neural network. Endoscopy 2020; 52: 786-791
• 17 Xing X, Jia X, Meng MQ. Bleeding detection in wireless capsule endoscopy image video using Superpixel-Color Histogram and a Subspace KNN Classifier. Annu Int Conf IEEE Eng Med Biol Soc 2018; 2018: 1-4
• 18 Aoki T, Yamada A, Kato Y. et al. Automatic detection of blood content in capsule endoscopy images based on a deep convolutional neural network. J Gastroenterol Hepatol 2020; 35: 1196-1200