Discriminative deep belief networks for visual data classification

Yan Liu, Shusen Zhou, Qingcai Chen

Research output: Journal article publicationJournal articleAcademic researchpeer-review

71 Citations (Scopus)

Abstract

Visual data classification using insufficient labeled data is a well-known hard problem. Semi-supervise learning, which attempts to exploit the unlabeled data in additional to the labeled ones, has attracted much attention in recent years. This paper proposes a novel semi-supervised classifier called discriminative deep belief networks (DDBN). DDBN utilizes a new deep architecture to integrate the abstraction ability of deep belief nets (DBN) and discriminative ability of backpropagation strategy. For unsupervised learning, DDBN inherits the advantage of DBN, which preserves the information well from high-dimensional features space to low-dimensional embedding. For supervised learning, through a well designed objective function, the backpropagation strategy directly optimizes the classification results in training dataset by refining the parameter space. Moreover, we apply DDBN to visual data classification task and observe an important fact that the learning ability of deep architecture is seriously underrated in real-world applications, especially in visual data analysis. The comparative experiments on standard datasets of different types and different scales demonstrate that the proposed algorithm outperforms both representative semi-supervised classifiers and existing deep learning techniques. For visual dataset, we can further improve the DDBN performance with much larger and deeper architecture.
Original languageEnglish
Pages (from-to)2287-2296
Number of pages10
JournalPattern Recognition
Volume44
Issue number10-11
DOIs
Publication statusPublished - 1 Oct 2011

Keywords

  • Deep learning
  • Discriminative deep belief networks
  • Semi-supervised learning
  • Visual data classification

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Cite this