University of Leicester
Browse
revision_07052021.pdf (2.47 MB)

Muti-view Mouse Social Behaviour Recognition with Deep Graphic Model

Download (2.47 MB)
journal contribution
posted on 2021-06-03, 07:43 authored by Z Jiang, F Zhou, A Zhao, X Li, L Li, D Tao, Huiyu Zhou
Home-cage social behaviour analysis of mice is aninvaluable tool to assess therapeutic efficacy of neurodegenerativediseases. Despite tremendous efforts made within the researchcommunity, single-camera video recordings are mainly used forsuch analysis. Because of the potential to create rich descriptionsfor mouse social behaviors, the use of multi-view video recordingsfor rodent observations is increasingly receiving much attention.However, identifying social behaviours from various views isstill challenging due to the lack of correspondence across datasources. To address this problem, we here propose a novel multi-view latent-attention and dynamic discriminative model thatjointly learns view-specific and view-shared sub-structures, wherethe former captures unique dynamics of each view whilst thelatter encodes the interaction between the views. Furthermore, anovel multi-view latent-attention variational autoencoder modelis introduced in learning the acquired features, enabling us tolearn discriminative features in each view. Experimental resultson the standard CRMI13 and our multi-view Parkinson’s DiseaseMouse Behaviour (PDMB) datasets demonstrate that our pro-posed model outperforms the other state of the arts technologies,has lower computational cost than the other graphical modelsand effectively deals with the imbalanced data problem.

History

Citation

IEEE Transactions on Image Processing ( Volume: 30), 2021 pp. 5490 - 5504

Author affiliation

School of Engineering

Version

  • AM (Accepted Manuscript)

Published in

IEEE Transactions on Image Processing

Volume

30

Pagination

5490-5504

Publisher

Institute of Electrical and Electronics Engineers

issn

1057-7149

Acceptance date

2021-05-07

Copyright date

2021

Available date

2021-06-03

Language

en

Usage metrics

    University of Leicester Publications

    Categories

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC