University of Leicester
Browse

Multimodal Gait Recognition for Neurodegenerative Diseases

Download (3.12 MB)
journal contribution
posted on 2021-02-10, 11:24 authored by A Zhao, J Li, J Dong, L Qi, Q Zhang, N Li, X Wang, Huiyu Zhou
In recent years, single modality based gait recognition has been extensively explored in the analysis of medical images or other sensory data, and it is recognised that each of the established approaches has different strengths and weaknesses. As an important motor symptom, gait disturbance is usually used for diagnosis and evaluation of diseases; moreover, the use of multi-modality analysis of the patient’s walking pattern compensates for the one-sidedness of single modality gait recognition methods that only learn gait changes in a single measurement dimension. Fusion of multiple measurement resources has demonstrated promising performance in the identification of gait patterns associated with individual diseases. In this paper, as an useful tool, we propose a novel hybrid model to learn the gait differences between three neurodegenerative diseases, between patients with different severity levels of Parkinson’s disease and between healthy individuals and patients, by fusing and aggregating data from multiple sensors. A spacial feature extractor (SFE) is applied to generating representative features of images or signals. In order to capture temporal information from the two modality data, a new correlative memory neural network(CorrMNN) architecture is designed for extracting temporal features. Afterwards, we embed a multi-switch discriminator to associate the observations with individual state estimations. Compared with several state of the art techniques, our proposed framework shows more accurate classification results.

History

Author affiliation

Department of Engineering

Version

  • AM (Accepted Manuscript)

Published in

IEEE Transactions on Cybernetics

Publisher

Institute of Electrical and Electronics Engineers

issn

1083-4419

Acceptance date

2021-01-21

Copyright date

2021

Available date

2021-05-06

Language

en

Usage metrics

    University of Leicester Publications

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC