Early Esophageal Adenocarcinoma detection using deep learning methods

Lists

Ghatwary, Noha, Ye, Xujiong and Zolgharni, Massoud ORCID: https://orcid.org/0000-0003-0904-2904 (2019) Early Esophageal Adenocarcinoma detection using deep learning methods. International Journal of Computer Assisted Radiology and Surgery, 14 (4). pp. 611-621. ISSN 1861-6410

Preview	PDF EarlyEsophagealAdenocarcinomaD.pdf - Published Version Available under License Creative Commons Attribution. Download (7MB) \| Preview
Preview	PDF Final_IJCARS-compressed.pdf - Accepted Version Available under License Creative Commons Attribution. Download (352kB) \| Preview

Official URL: https://doi.org/10.1007/s11548-019-01914-4

Abstract

Purpose: This study aims to adapt and evaluate the performance of different state-of-the-art deep learning object detection methods to automatically identify Esophageal Adenocarcinoma (EAC) regions from High-Definition White Light Endoscopy (HD-WLE) images.

Method: Several state-of-the-art object detection methods using Convolution Neural Networks (CNN’s) were adapted to automatically detect abnormal regions in the esophagus HD-WLE images, utilizing VGG’16 as the backbone architecture for feature extraction. Those methods are Regional-based Convolutional Neural Network (R-CNN), Fast R-CNN, Faster R-CNN and Single Shot Multi-box Detector (SSD). For the evaluation of the different methods, 100 images from 39 patients that have been manually annotated by five experienced clinicians as ground truth have been tested.

Results: Experimental results illustrate that the SSD and Faster R-CNN networks show promising results, the SSD outperforms other methods achieving a sensitivity of 0.96, specificity of 0.92 and f-measure of 0.94. Additionally, the average recall rate of the Faster R-CNN in locating the EAC region accurately is 0.83.

Conclusion: In this paper, recent deep learning object detection methods are adapted to detect esophageal abnormalities automatically. The evaluation of the methods proved its ability to locate abnormal regions in the esophagus from endoscopic images. The automatic detection is a crucial step that may help early detection and treatment of EAC and also can improve automatic tumor segmentation to monitor its growth and treatment outcome.

Item Type:	Article
Identifier:	10.1007/s11548-019-01914-4
Additional Information:	This article is distributed under the terms of the CreativeCommons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution,and reproduction in any medium, provided you give appropriate creditto the original author(s) and the source, provide a link to the CreativeCommons license, and indicate if changes were made
Keywords:	Deep Learning, Esophageal Adenocarcinoma detection, Barrett’s Esophagus, HD-WLE
Subjects:	Computing > Intelligent systems
Related URLs:	Publisher
Depositing User:	Massoud Zolgharni
Date Deposited:	14 Jan 2019 10:10
Last Modified:	04 Nov 2024 12:00
URI:	https://repository.uwl.ac.uk/id/eprint/5742

Downloads

Downloads per month over past year

Actions (login required)

View Item

References

1.
https://seer.cancer.gov/statfacts/html/esoph.html
2.
Rajendra S, Sharma P (2017) Barrett esophagus and intramucosal esophageal adenocarcinoma. Hematol Oncol Clin 31(3):409–426
3.
Qi X, Sivak MV, Isenberg G, Willis J, Rollins AM (2006) Computer-aided diagnosis of dysplasia in Barrett’s esophagus using endoscopic optical coherence tomography. J Biomed Opt 11(4):044010
4.
Old OJ, Lloyd GR, Nallala J, Isabelle M, Almond LM, Shepherd NA, Kendall CA, Shore AC, Barr H, Stone N (2017) Rapid infrared mapping for highly accurate automated histology in Barrett’s oesophagus. Analyst 142(8):1227–1234
5.
Jiang Y, Gong Y, Rubenstein JH, Wang TD, Seibel EJ (2017) Toward real-time quantification of fluorescence molecular probes using target/background ratio for guiding biopsy and endoscopic therapy of esophageal neoplasia. J Med Imaging 4(2):024502
6.
Behrens A, Pech O, Graupe F, May A, Lorenz D, Ell C (2011) Barrett’s adenocarcinoma of the esophagus: better outcomes through new methods of diagnosis and treatment. Deutsch rzteblatt Int. 108(18):313
7.
Trovato C, Sonzogni A, Ravizza D, Fiori G, Tamayo D, De Roberto G, de Leone A, De Lisi S, Crosta C (2013) Confocal laser endomicroscopy for in vivo diagnosis of Barrett’s oesophagus and associated neoplasia: a pilot study conducted in a single Italian centre. Dig Liver Dis 45(5):396–402
8.
Ghatwary N, Ahmed A, Ye X, Jalab H (2017) Automatic grade classification of Barretts esophagus through feature enhancement. In Medical imaging 2017: computer-aided diagnosis, vol 10134. International Society for Optics and Photonics, p 1013433
9.
Van Der Sommen F, Zinger S, Schoon EJ (2014) Supportive automatic annotation of early esophageal cancer using local gabor and color features. Neurocomputing 144:92–106
10.
Ghatwary N, Ahmed A, Ye X (2017) Automated detection of Barrett’s esophagus using endoscopic images: a survey. In: Annual conference on medical image understanding and analysis, pp 897–908
11.
de Souza LA, Palm C, Mendel R, Hook C, Ebigbo A, Probst A, Messmann H, Weber S, Papa JP (2018) A survey on Barrett’s esophagus analysis using machine learning. Comput Biol Med 96:203–213
12.
Juefei-Xu F, Boddeti VN, Savvides M, Juefei-Xu F, Boddeti VN, Savvides M (2017) Local binary convolutional neural networks. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), vol 1
13.
Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JA, van Ginneken B, Snchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88
14.
Setio AA, Van Der Sommen F, Zinger S, Schoon EJ, de With Peter HN (2013) Evaluation and comparison of textural feature representation for the detection of early stage cancer in endoscopy. VISAPP 1:238–243
15.
Van Der Sommen F, Zinger S, Schoon EJ (2013) Computer-aided detection of early cancer in the esophagus using HD endoscopy images. In: Medical imaging 2013: computer-aided diagnosis, vol 8670. International Society for Optics and Photonics, p 86700V
16.
van der Sommen F, Zinger S, Curvers WL, Bisschops R, Pech O, Weusten BL, Bergman JJ, Schoon EJ (2016) Computer-aided detection of early neoplastic lesions in Barrett’s esophagus. Endoscopy 48(07):617–624
17.
Janse MH, van der Sommen F, Zinger S, Schoon EJ (2016) Early esophageal cancer detection using RF classifiers. In: Medical imaging 2016: computer-aided diagnosis, vol 9785. International Society for Optics and Photonics, p 97851D
18.
Souza L, Hook C, Papa JP, Palm C (2017) Barrett’s esophagus analysis using SURF features. Bildverarb Med 2017:141–146
19.
De Souza LA, Afonso LCS, Palm C, Papa JP (2017) Barrett’s esophagus identification using optimum-path forest. In: 2017 30th SIBGRAPI conference on graphics, patterns and images (SIBGRAPI), pp 308–331
20.
Mendel R, Ebigbo A, Probst A, Messmann H, Palm C (2017) Barrett’s esophagus analysis using convolutional neural networks. In: Bildverarbeitung fur die Medizin 2017. Springer, Berlin, pp 80–85
21.
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
22.
Li W, Breier M, Merhof D (2016) Recycle deep features for better object detection. arXiv preprint arXiv:1607.05066
23.
Shen H, Manivannan S, Annunziata R, Wang R, Zhang J (2016) Combination of CNN and hand-crafted feature for ischemic Stroke Lesion segmentation. Ischemic stroke lesion segmentation, p 1
24.
Antipov G, Berrani SA, Ruchaud N, Dugelay JL (2015) Learned vs. hand-crafted features for pedestrian gender recognition. In: Proceedings of the 23rd ACM international conference on Multimedia, pp 1263–1266
25.
Mnih V, Kavukcuoglu K, Silver D, Graves A, Antonoglou I, Wierstra D, Riedmiller M (2013) Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602
26.
Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 580–587
27.
Uijlings JR, Van De Sande KE, Gevers T, Smeulders AW (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171
28.
Girshick R (2015) Fast r-cnn. arXiv preprint arXiv:1504.08083
29.
Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149
30.
Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) Ssd: single shot multibox detector. In: European conference on computer vision, pp 21–37
31.
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556
32.
https://endovissub-barrett.grand-challenge.org
33.
Chollet F (2015) Keras. https://keras.io/
34.
Xian M, Zhang Y, Cheng HD (2015) Fully automatic segmentation of breast ultrasound images based on breast characteristics in space and frequency domains. Pattern Recognit 48(2):485–497

Tools

CORE (COnnecting REpositories)

The University of West London

Early Esophageal Adenocarcinoma detection using deep learning methods

Abstract

Downloads

Actions (login required)

Menu