Endoscopy 2021; 53(05): 491-498
DOI: 10.1055/a-1244-5698
Original article

Intelligent difficulty scoring and assistance system for endoscopic extraction of common bile duct stones based on deep learning: multicenter study

Li Huang*
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
,
Xiaoyan Lu*
4  State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan, China
,
Xu Huang
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
,
Xiaoping Zou
5  Department of Gastroenterology, Nanjing Drum Tower Hospital of Nanjing University Medical School, Nanjing, China
,
Lianlian Wu
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
,
Zhongyin Zhou
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
,
Deqing Wu
6  Department of Gastroenterology, Tenth People Hospital of Tongji University, Shanghai, China
,
Dehua Tang
5  Department of Gastroenterology, Nanjing Drum Tower Hospital of Nanjing University Medical School, Nanjing, China
,
Dingyuan Chen
4  State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan, China
,
Xinyue Wan
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
,
Zhongchao Zhu
7  Department of Pancreatic Surgery, Renmin Hospital of Wuhan University, Wuhan, China
,
Tao Deng
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
,
Lei Shen
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
,
Jun Liu
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
,
Yijie Zhu
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
,
Dexin Gong
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
,
Di Chen
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
,
Yanfei Zhong
4  State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan, China
,
Feng Liu
6  Department of Gastroenterology, Tenth People Hospital of Tongji University, Shanghai, China
,
Honggang Yu
1  Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
2  Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
3  Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
› Author Affiliations

Abstract

Background The study aimed to construct an intelligent difficulty scoring and assistance system (DSAS) for endoscopic retrograde cholangiopancreatography (ERCP) treatment of common bile duct (CBD) stones.

Methods 1954 cholangiograms were collected from three hospitals for training and testing the DSAS. The D-LinkNet34 and U-Net were adopted to segment the CBD, stones, and duodenoscope. Based on the segmentation results, the stone size, distal CBD diameter, distal CBD arm, and distal CBD angulation were estimated. The performance of segmentation and estimation was assessed by mean intersection over union (mIoU) and average relative error. A technical difficulty scoring scale, which was used for assessing the technical difficulty of CBD stone removal, was developed and validated. We also analyzed the relationship between scores evaluated by the DSAS and clinical indicators including stone clearance rate and need for endoscopic papillary large-balloon dilation (EPLBD) and lithotripsy.

Results The mIoU values of the stone, CBD, and duodenoscope segmentation were 68.35 %, 86.42 %, and 95.85 %, respectively. The estimation performance of the DSAS was superior to nonexpert endoscopists. In addition, the technical difficulty scoring performance of the DSAS was more consistent with expert endoscopists than two nonexpert endoscopists. A DSAS assessment score ≥ 2 was correlated with lower stone clearance rates and more frequent EPLBD.

Conclusions An intelligent DSAS based on deep learning was developed. The DSAS could assist endoscopists by automatically scoring the technical difficulty of CBD stone extraction, and guiding the choice of therapeutic approach and appropriate accessories during ERCP.

* These authors contributed equally to this work.


Supplementary material



Publication History

Received: 14 March 2020

Accepted: 21 August 2020

Publication Date:
24 August 2020 (online)

© 2020. Thieme. All rights reserved.

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany