Linear dependency modeling for classifier fusion and feature combination

Andy Jinhua Ma*, Pong Chi YUEN, Jian Huang Lai

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

27 Citations (Scopus)

Abstract

This paper addresses the independent assumption issue in fusion process. In the last decade, dependency modeling techniques were developed under a specific distribution of classifiers or by estimating the joint distribution of the posteriors. This paper proposes a new framework to model the dependency between features without any assumption on feature/classifier distribution, and overcomes the difficulty in estimating the high-dimensional joint density. In this paper, we prove that feature dependency can be modeled by a linear combination of the posterior probabilities under some mild assumptions. Based on the linear combination property, two methods, namely, Linear Classifier Dependency Modeling (LCDM) and Linear Feature Dependency Modeling (LFDM), are derived and developed for dependency modeling in classifier level and feature level, respectively. The optimal models for LCDM and LFDM are learned by maximizing the margin between the genuine and imposter posterior probabilities. Both synthetic data and real datasets are used for experiments. Experimental results show that LCDM and LFDM with dependency modeling outperform existing classifier level and feature level combination methods under nonnormal distributions and on four real databases, respectively. Comparing the classifier level and feature level fusion methods, LFDM gives the best performance.

Original languageEnglish
Article number6302141
Pages (from-to)1135-1148
Number of pages14
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume35
Issue number5
DOIs
Publication statusPublished - 2013

Scopus Subject Areas

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics

User-Defined Keywords

  • classifier level fusion
  • feature dependency
  • feature level fusion
  • Linear dependency modeling
  • multiple feature fusion

Fingerprint

Dive into the research topics of 'Linear dependency modeling for classifier fusion and feature combination'. Together they form a unique fingerprint.

Cite this