Skip to main navigation Skip to search Skip to main content

MetaViT: Metabolism-Aware Vision Transformer for Differential Diagnosis of Parkinsonism with 18 F-FDG PET

  • Lin Zhao
  • , Hexin Dong
  • , Ping Wu
  • , Jiaying Lu
  • , Le Lu
  • , Jingren Zhou
  • , Tianming Liu
  • , Li Zhang
  • , Ling Zhang
  • , Yuxing Tang
  • , Chuantao Zuo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Accurate and early differential diagnosis of parkinsonism (idiopathic Parkinson’s disease, multiple system atrophy, and progressive supranuclear palsy) is crucial for informing prognosis and determining treatment strategies. Current automated differential diagnosis methods for 18 F-fluorodeoxyglucose (18 F-FDG) positron emission tomography (PET) scans, such as convolutional neural networks (CNNs), often focus on local brain regions and do not explicitly model the complex metabolic interactions between distinct brain regions. These interactions, as reflected in FDG PET images, are keys for the differential diagnosis of parkinsonism. Vision transformer (ViT) models are promising in modeling such long-range dependencies, but they may overlook the local metabolic alternations and have not been widely adapted for 3D medical image classification due to data limitations. Therefore, we propose a novel metabolism-aware vision transformer (MetaViT), which uses self-attention and convolution to explicitly characterize both global and local metabolic interactions between interrelated brain regions. A masked image reconstruction task is introduced to guide the MetaViT model to focus on disease-related brain regions, addressing the scarcity of 3D medical imaging data and improving the trustworthiness and interpretability of the resulting model. The proposed framework is evaluated on a 3D FDG PET imaging dataset with 902 subjects, achieving a high accuracy of 97.7% in the differential diagnosis of parkinsonism and outperforming several state-of-the-art CNN and ViT-based approaches.

Original languageEnglish (US)
Title of host publicationInformation Processing in Medical Imaging - 28th International Conference, IPMI 2023, Proceedings
EditorsAlejandro Frangi, Marleen de Bruijne, Demian Wassermann, Nassir Navab
PublisherSpringer Science and Business Media Deutschland GmbH
Pages132-144
Number of pages13
ISBN (Print)9783031340475
DOIs
StatePublished - 2023
Externally publishedYes
Event28th International Conference on Information Processing in Medical Imaging, IPMI 2023 - San Carlos de Bariloche, Argentina
Duration: Jun 18 2023Jun 23 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13939 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference28th International Conference on Information Processing in Medical Imaging, IPMI 2023
Country/TerritoryArgentina
CitySan Carlos de Bariloche
Period6/18/236/23/23

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science

Keywords

  • Early Differential Diagnosis
  • Masked Image Reconstruction
  • Parkinsonism
  • PET
  • Transformer

Fingerprint

Dive into the research topics of 'MetaViT: Metabolism-Aware Vision Transformer for Differential Diagnosis of Parkinsonism with 18 F-FDG PET'. Together they form a unique fingerprint.

Cite this