Brain tumor classification with tumor segmentations and a dual path residual convolutional neural network from MRI and pathology images

Yunzhe Xue, Yanan Yang, Fadi G. Farhat, Frank Y. Shih, Olga Boukrina, A. M. Barrett, Jeffrey R. Binder, William W. Graves, Usman W. Roshan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Brain tumor classification plays an important role in brain cancer diagnosis and treatment. Pathologists typically have to work through numerous pathology images that can be in the order of hundreds or thousands which takes time and is prone to manual error. Here we investigate automating this task given pathology images as well as 3D MRI volumes without lesion maps. We use data provided by the CPM-RadPath 2019 MICCAI challenge. We first evaluate accuracy on the validation dataset with MRI and pathology images separately. We predict the 3D tumor mask with our custom developed tumor segmentation model that we used for the BraTS 2019 challenge. We show that the predicted tumor segmentations give a higher validation accuracy of 77.1% vs. 69.8% with MRI images when trained by a 3D residual convolutional neural network. For pathology images we train a 2D residual network and obtain a 66.2% validation accuracy. In both cases we find high training accuracies above 95% which suggests overfitting. We propose a dual path residual convolutional neural network model that trains simultaneously from both MRI and pathology images and we use a simple method to prevent overfitting. One path of our network is fully 3D and considers 3D tumor segmentations as input while the other path considers pathology images. To prevent overfitting we stop training after 90% training accuracy at the epoch number where our network loss increases in the following one. With this approach we achieve a validation accuracy of 84.9% showing that indeed combining the two image sources yields a better overall accuracy.

Original languageEnglish (US)
Title of host publicationBrainlesion
Subtitle of host publicationGlioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries - 5th International Workshop, BrainLes 2019, Held in Conjunction with MICCAI 2019, Revised Selected Papers
EditorsAlessandro Crimi, Spyridon Bakas
PublisherSpringer
Pages360-367
Number of pages8
ISBN (Print)9783030466428
DOIs
StatePublished - 2020
Event5th International MICCAI Brainlesion Workshop, BrainLes 2019, held in conjunction with the Medical Image Computing for Computer Assisted Intervention, MICCAI 2019 - Shenzhen, China
Duration: Oct 17 2019Oct 17 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11993 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference5th International MICCAI Brainlesion Workshop, BrainLes 2019, held in conjunction with the Medical Image Computing for Computer Assisted Intervention, MICCAI 2019
Country/TerritoryChina
CityShenzhen
Period10/17/1910/17/19

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Keywords

  • Brain MRI
  • Convolutional neural networks
  • Pathology
  • Residual networks

Fingerprint

Dive into the research topics of 'Brain tumor classification with tumor segmentations and a dual path residual convolutional neural network from MRI and pathology images'. Together they form a unique fingerprint.

Cite this