Deep learning for detection and segmentation of artefact and disease instances in gastrointestinal endoscopy: Medical Image Analysis

S. Ali, M. Dmitrieva, N. Ghatwary, S. Bano, G. Polat, A. Temizel, A. Krenzer, A. Hekalo, Y.B. Guo, B. Matuszewski, M. Gridach, I. Voiculescu, V. Yoganand, A. Chavan, A. Raj, N.T. Nguyen, D.Q. Tran, L.D. Huynh, N. Boutry, S. RezvyH. Chen, Y.H. Choi, A. Subramanian, V. Balasubramanian, X.W. Gao, H. Hu, Y. Liao, D. Stoyanov, C. Daul, S. Realdon, R. Cannizzaro, D. Lamarque, T. Tran-Nguyen, A. Bailey, B. Braden, J.E. East, J. Rittscher

Research output: Contribution to journalArticlepeer-review


The Endoscopy Computer Vision Challenge (EndoCV) is a crowd-sourcing initiative to address eminent problems in developing reliable computer aided detection and diagnosis endoscopy systems and suggest a pathway for clinical translation of technologies. Whilst endoscopy is a widely used diagnostic and treatment tool for hollow-organs, there are several core challenges often faced by endoscopists, mainly: 1) presence of multi-class artefacts that hinder their visual interpretation, and 2) difficulty in identifying subtle precancerous precursors and cancer abnormalities. Artefacts often affect the robustness of deep learning methods applied to the gastrointestinal tract organs as they can be confused with tissue of interest. EndoCV2020 challenges are designed to address research questions in these remits. In this paper, we present a summary of methods developed by the top 17 teams and provide an objective comparison of state-of-the-art methods and methods designed by the participants for two sub-challenges: i) artefact detection and segmentation (EAD2020), and ii) disease detection and segmentation (EDD2020). Multi-center, multi-organ, multi-class, and multi-modal clinical endoscopy datasets were compiled for both EAD2020 and EDD2020 sub-challenges. The out-of-sample generalization ability of detection algorithms was also evaluated. Whilst most teams focused on accuracy improvements, only a few methods hold credibility for clinical usability. The best performing teams provided solutions to tackle class imbalance, and variabilities in size, origin, modality and occurrences by exploring data augmentation, data fusion, and optimal class thresholding techniques. © 2021 The Authors
Original languageEnglish
Article number102002
Number of pages24
JournalMed. Image Anal.
Publication statusPublished - 2021


  • Artefact
  • Challenge
  • Deep learning
  • Detection
  • Disease
  • Endoscopy
  • Gastroenterology
  • Segmentation
  • Computer aided diagnosis
  • Data fusion
  • Learning systems
  • Accuracy Improvement
  • Computer-aided detection and diagnosis
  • Gastrointestinal endoscopies
  • Gastrointestinal tract
  • Generalization ability
  • State-of-the-art methods
  • Thresholding techniques
  • Visual interpretation
  • Article
  • artifact
  • computer vision
  • deep learning
  • detection algorithm
  • gastrointestinal endoscopy
  • human
  • image segmentation
  • information processing
  • priority journal
  • algorithm
  • Algorithms
  • Artifacts
  • Deep Learning
  • Endoscopy, Gastrointestinal
  • Humans


Dive into the research topics of 'Deep learning for detection and segmentation of artefact and disease instances in gastrointestinal endoscopy: Medical Image Analysis'. Together they form a unique fingerprint.

Cite this