Bradykinesia recognition in Parkinson's disease via single RGB video

Bo Lin, Wei Luo, Zhiling Luo, Bo Wang, Shuiguang Deng, Jianwei Yin, Mengchu Zhou

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Parkinson's disease is a progressive nervous system disorder afflicting millions of patients. Among its motor symptoms, bradykinesia is one of the cardinal manifestations. Experienced doctors are required for the clinical diagnosis of bradykinesia, but sometimes they also miss subtle changes, especially in early stages of such disease. Therefore, developing auxiliary diagnostic methods that can automatically detect bradykinesia has received more and more attention. In this article, we employ a two-stage framework for bradykinesia recognition based on the video of patient movement. First, convolution neural networks are trained to localize keypoints in each video frame. These time-varying coordinates form motion trajectories that represent the whole movement. From the trajectory, we then propose novel measurements, namely stability, completeness, and self-similarity, to quantify different motor behaviors. We also propose a periodic motion model called PMNet. An encoder-decoder structure is applied to learn a low dimensional representation of a motion process. The compressed motion process and quantified motor behaviors are combined as inputs to a fully-connected neural network. Different from the traditional means, our solution extends the application scenario outside the hospital and can be easily transplanted to conduct similar tasks. A commonly used clinical assessment is served as a case study. Experimental results based on real-world data validate the effectiveness of our approach for bradykinesia recognition.

Original languageEnglish (US)
Article number16
JournalACM Transactions on Knowledge Discovery from Data
Volume14
Issue number2
DOIs
StatePublished - Feb 2020

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

Keywords

  • Bradykinesia
  • Computer vision
  • Parkinson's disease
  • RGB video
  • Time sequence analysis

Fingerprint

Dive into the research topics of 'Bradykinesia recognition in Parkinson's disease via single RGB video'. Together they form a unique fingerprint.

Cite this