Incremental multi-linear discriminant analysis using canonical correlations for action recognition

Cheng-Cheng Jia, Su-Jing Wang, Xu-Jun Peng, Wei Pang, Can-Yan Zhang, Chunguang Zhou, Zhe-Zhou Yu

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

Canonical correlations analysis (CCA) is often used for feature extraction and dimensionality reduction. However, the image vectorization of CCA breaks the spatial structure of the original image, and the excessive dimensions of vectors often cause the curse of dimensionality problem. In this paper, we propose a novel feature extraction method based on CCA in multi-linear discriminant subspace by encoding each action sample as a high-order tensor. An optimization approach is presented to iteratively learn the discriminant subspace by unfolding the tensor along different tensor modes, which shows that most of the underlying data structure, including the spatio-temporal information, is retained and the curse of dimensionality problem is alleviated by the use of the proposed approach. At the same time, an incremental scheme is developed for multi-linear subspace online learning, which can improve the discriminative capability efficiently and effectively. In addition, the nearest neighbor classifier (NNC) is employed for action classification. Experiments on the Weizmann database show that the proposed method outperforms the state-of-the-art methods in terms of accuracy and time complexity, and it is robust against partial occlusion.
Original languageEnglish
Pages (from-to)56-63
Number of pages8
JournalNeurocomputing
Volume83
Issue number-
Early online date27 Dec 2011
DOIs
Publication statusPublished - 15 Apr 2012

Fingerprint

Discriminant Analysis
Discriminant analysis
Tensors
Feature extraction
Spatial Analysis
Data structures
Classifiers
Learning
Databases
Recognition (Psychology)
Experiments

Keywords

  • Canonical correlations analysis
  • Multi-linear subspace
  • Discriminant information
  • Incremental learning
  • Action recognition

Cite this

Incremental multi-linear discriminant analysis using canonical correlations for action recognition. / Jia, Cheng-Cheng; Wang, Su-Jing; Peng, Xu-Jun; Pang, Wei; Zhang, Can-Yan; Zhou, Chunguang ; Yu, Zhe-Zhou.

In: Neurocomputing, Vol. 83, No. -, 15.04.2012, p. 56-63.

Research output: Contribution to journalArticle

Jia, Cheng-Cheng ; Wang, Su-Jing ; Peng, Xu-Jun ; Pang, Wei ; Zhang, Can-Yan ; Zhou, Chunguang ; Yu, Zhe-Zhou. / Incremental multi-linear discriminant analysis using canonical correlations for action recognition. In: Neurocomputing. 2012 ; Vol. 83, No. -. pp. 56-63.
@article{bd4abd4a1f524e6f87e98c6b3d5f43ef,
title = "Incremental multi-linear discriminant analysis using canonical correlations for action recognition",
abstract = "Canonical correlations analysis (CCA) is often used for feature extraction and dimensionality reduction. However, the image vectorization of CCA breaks the spatial structure of the original image, and the excessive dimensions of vectors often cause the curse of dimensionality problem. In this paper, we propose a novel feature extraction method based on CCA in multi-linear discriminant subspace by encoding each action sample as a high-order tensor. An optimization approach is presented to iteratively learn the discriminant subspace by unfolding the tensor along different tensor modes, which shows that most of the underlying data structure, including the spatio-temporal information, is retained and the curse of dimensionality problem is alleviated by the use of the proposed approach. At the same time, an incremental scheme is developed for multi-linear subspace online learning, which can improve the discriminative capability efficiently and effectively. In addition, the nearest neighbor classifier (NNC) is employed for action classification. Experiments on the Weizmann database show that the proposed method outperforms the state-of-the-art methods in terms of accuracy and time complexity, and it is robust against partial occlusion.",
keywords = "Canonical correlations analysis, Multi-linear subspace, Discriminant information, Incremental learning, Action recognition",
author = "Cheng-Cheng Jia and Su-Jing Wang and Xu-Jun Peng and Wei Pang and Can-Yan Zhang and Chunguang Zhou and Zhe-Zhou Yu",
note = "A paid open access option is available for this journal. Voluntary deposit by author of pre-print allowed on Institutions open scholarly website and pre-print servers Voluntary deposit by author of authors post-print allowed on institutions open scholarly website including Institutional Repository Deposit due to Funding Body, Institutional and Governmental mandate only allowed where separate agreement between repository and publisher exists Set statement to accompany deposit Published source must be acknowledged Must link to journal home page or articles' DOI Publisher's version/PDF cannot be used Articles in some journals can be made Open Access on payment of additional charge NIH Authors articles will be submitted to PubMed Central after 12 months Authors who are required to deposit in subject-based repositories may also use Sponsorship Option",
year = "2012",
month = "4",
day = "15",
doi = "10.1016/j.neucom.2011.11.006",
language = "English",
volume = "83",
pages = "56--63",
journal = "Neurocomputing",
issn = "0925-2312",
publisher = "ELSEVIER SCIENCE BV",
number = "-",

}

TY - JOUR

T1 - Incremental multi-linear discriminant analysis using canonical correlations for action recognition

AU - Jia, Cheng-Cheng

AU - Wang, Su-Jing

AU - Peng, Xu-Jun

AU - Pang, Wei

AU - Zhang, Can-Yan

AU - Zhou, Chunguang

AU - Yu, Zhe-Zhou

N1 - A paid open access option is available for this journal. Voluntary deposit by author of pre-print allowed on Institutions open scholarly website and pre-print servers Voluntary deposit by author of authors post-print allowed on institutions open scholarly website including Institutional Repository Deposit due to Funding Body, Institutional and Governmental mandate only allowed where separate agreement between repository and publisher exists Set statement to accompany deposit Published source must be acknowledged Must link to journal home page or articles' DOI Publisher's version/PDF cannot be used Articles in some journals can be made Open Access on payment of additional charge NIH Authors articles will be submitted to PubMed Central after 12 months Authors who are required to deposit in subject-based repositories may also use Sponsorship Option

PY - 2012/4/15

Y1 - 2012/4/15

N2 - Canonical correlations analysis (CCA) is often used for feature extraction and dimensionality reduction. However, the image vectorization of CCA breaks the spatial structure of the original image, and the excessive dimensions of vectors often cause the curse of dimensionality problem. In this paper, we propose a novel feature extraction method based on CCA in multi-linear discriminant subspace by encoding each action sample as a high-order tensor. An optimization approach is presented to iteratively learn the discriminant subspace by unfolding the tensor along different tensor modes, which shows that most of the underlying data structure, including the spatio-temporal information, is retained and the curse of dimensionality problem is alleviated by the use of the proposed approach. At the same time, an incremental scheme is developed for multi-linear subspace online learning, which can improve the discriminative capability efficiently and effectively. In addition, the nearest neighbor classifier (NNC) is employed for action classification. Experiments on the Weizmann database show that the proposed method outperforms the state-of-the-art methods in terms of accuracy and time complexity, and it is robust against partial occlusion.

AB - Canonical correlations analysis (CCA) is often used for feature extraction and dimensionality reduction. However, the image vectorization of CCA breaks the spatial structure of the original image, and the excessive dimensions of vectors often cause the curse of dimensionality problem. In this paper, we propose a novel feature extraction method based on CCA in multi-linear discriminant subspace by encoding each action sample as a high-order tensor. An optimization approach is presented to iteratively learn the discriminant subspace by unfolding the tensor along different tensor modes, which shows that most of the underlying data structure, including the spatio-temporal information, is retained and the curse of dimensionality problem is alleviated by the use of the proposed approach. At the same time, an incremental scheme is developed for multi-linear subspace online learning, which can improve the discriminative capability efficiently and effectively. In addition, the nearest neighbor classifier (NNC) is employed for action classification. Experiments on the Weizmann database show that the proposed method outperforms the state-of-the-art methods in terms of accuracy and time complexity, and it is robust against partial occlusion.

KW - Canonical correlations analysis

KW - Multi-linear subspace

KW - Discriminant information

KW - Incremental learning

KW - Action recognition

U2 - 10.1016/j.neucom.2011.11.006

DO - 10.1016/j.neucom.2011.11.006

M3 - Article

VL - 83

SP - 56

EP - 63

JO - Neurocomputing

JF - Neurocomputing

SN - 0925-2312

IS - -

ER -