Deep Transfer Learning for Automated Intestinal Bleeding Detection in Capsule Endoscopy Imaging

Tonmoy Ghosh, Jacob Chakareski

Research output: Contribution to journalArticlepeer-review

30 Scopus citations


Purpose: The objective of this paper was to develop a computer-aided diagnostic (CAD) tools for automated analysis of capsule endoscopic (CE) images, more precisely, detect small intestinal abnormalities like bleeding. Methods: In particular, we explore a convolutional neural network (CNN)-based deep learning framework to identify bleeding and non-bleeding CE images, where a pre-trained AlexNet neural network is used to train a transfer learning CNN that carries out the identification. Moreover, bleeding zones in a bleeding-identified image are also delineated using deep learning-based semantic segmentation that leverages a SegNet deep neural network. Results: To evaluate the performance of the proposed framework, we carry out experiments on two publicly available clinical datasets and achieve a 98.49% and 88.39% F1 score, respectively, on the capsule and KID datasets. For bleeding zone identification, 94.42% global accuracy and 90.69% weighted intersection over union (IoU) are achieved. Conclusion: Finally, our performance results are compared to other recently developed state-of-the-art methods, and consistent performance advances are demonstrated in terms of performance measures for bleeding image and bleeding zone detection. Relative to the present and established practice of manual inspection and annotation of CE images by a physician, our framework enables considerable annotation time and human labor savings in bleeding detection in CE images, while providing the additional benefits of bleeding zone delineation and increased detection accuracy. Moreover, the overall cost of CE enabled by our framework will also be much lower due to the reduction of manual labor, which can make CE affordable for a larger population.

Original languageEnglish (US)
Pages (from-to)404-417
Number of pages14
JournalJournal of Digital Imaging
Issue number2
StatePublished - Apr 2021

All Science Journal Classification (ASJC) codes

  • Radiological and Ultrasound Technology
  • Radiology Nuclear Medicine and imaging
  • Computer Science Applications


  • AlexNet
  • Bleeding detection
  • Capsule endoscopy
  • Convolutional neural network
  • Deep learning
  • SegNet


Dive into the research topics of 'Deep Transfer Learning for Automated Intestinal Bleeding Detection in Capsule Endoscopy Imaging'. Together they form a unique fingerprint.

Cite this