Endoscopy 2019; 51(04): S6-S7
DOI: 10.1055/s-0039-1681188
ESGE Days 2019 oral presentations
Friday, April 5, 2019 08:30 – 10:30: Artificial intelligence Club A
Georg Thieme Verlag KG Stuttgart · New York

AUTOMATIC GLANDS SEGMENTATION IN HISTOLOGICAL IMAGES OBTAINED BY ENDOSCOPIC BIOPSY FROM VARIOUS PARTS OF THE COLON

N Oleynikova
1  Lomonosov Moscow State University, Department of Pathology, Moscow, Russian Federation
,
A Khvostikov
2  Lomonosov Moscow State University, Faculty of Computational Mathematics and Cybernetics, Moscow, Russian Federation
,
A Krylov
2  Lomonosov Moscow State University, Faculty of Computational Mathematics and Cybernetics, Moscow, Russian Federation
,
I Mikhailov
1  Lomonosov Moscow State University, Department of Pathology, Moscow, Russian Federation
,
O Kharlova
1  Lomonosov Moscow State University, Department of Pathology, Moscow, Russian Federation
,
N Danilova
1  Lomonosov Moscow State University, Department of Pathology, Moscow, Russian Federation
,
P Malkov
1  Lomonosov Moscow State University, Department of Pathology, Moscow, Russian Federation
,
N Ageykina
3  Medsi Clinic, Department of Endoscopy, Moscow, Russian Federation
,
E Fedorov
4  Lomonosov Moscow State University, Department of Endoscopy, Moscow, Russian Federation
5  Pirogov Russian National Research Medical University (RNRMU), Moscow, Russian Federation
› Author Affiliations
Further Information

Publication History

Publication Date:
18 March 2019 (online)

 

Aims:

Artificial intelligence is rapidly gaining ground in online detection, endoscopic and morphological characterization of colon epithelial neoplasms. Even for pathologists identification of metaplasia and dysplasia in the epithelium of the mucous glands could be an extremely difficult task. The same task in vivo, directly during the endoscopic examination is no less difficult, therefore the development of auxiliary mathematical models for image recognition is requested.

Methods:

We propose a new design of a convolutional neural network (CNN) based on U-Net model and use it for mucous glands segmentation. The main distinctive ideas of the proposed CNN lay in the multiscale architecture, using non-local blocks to capture long-range dependencies in the image and using a contour-aware loss function. The network was first trained on the public Warwick-QU dataset with non-linear augmentation process and was afterthat fine-tuned on the manually labeled histological images obtained from paraffin sections of endoscopic biopsy material of the colon.

Results:

The multiscale architecture of the proposed segmentational CNN makes it less sensitive to the scale of the input image. Due to the specific loss function it is able to detect and separate “stuck” glands. The used non-linear blocks have a positive effect on the time needed for model to converge. Altogether this leads to the accurate segmentation of glands on histology images (Dice coefficient = 0.87 for Warwick-QU dataset, Dice coefficient = 0.83 for the obtained dataset).

Conclusions:

The generalization ability of the proposed algorithm enables it to effectively segment individual glands as well as to perform inner-gland segmentation (detect nuclei, lumen and cytoplasm) in histological images. The subsequent development of this gland segmentation technology can allow to detect changes in the lumen shape (serration) of glands, in the nuclear-cytoplasmic ratio inside mucus-forming cells, and in the character of the expression of immunohistochemical markers.