Stochastic feature transformation with divergence-based out-of-handset rejection for robust speaker verification

Man Wai Mak, Chi Leung Tsang, Sun Yuan Kung

Research output: Journal article publicationJournal articleAcademic researchpeer-review

11 Citations (Scopus)


The performance of telephone-based speaker verification systems can be severely degraded by linear and nonlinear acoustic distortion caused by telephone handsets. This paper proposes to combine a handset selector with stochastic feature transformation to reduce the distortion. Specifically, a Gaussian mixture model (GMM)-based handset selector is trained to identify the most likely handset used by the claimants, and then handset-specific stochastic feature transformations are applied to the distorted feature vectors. This paper also proposes a divergence-based handset selector with out-of-handset (OOH) rejection capability to identify the "unseen" handsets. This is achieved by measuring the Jensen difference between the selector's output and a constant vector with identical elements. The resulting handset selector is combined with the proposed feature transformation technique for telephone-based speaker verification. Experimental results based on 150 speakers of the HTIMIT corpus show that the handset selector, either with or without OOH rejection capability, is able to identify the "seen" handsets accurately (98.3% in both cases). Results also demonstrate that feature transformation performs significantly better than the classical cepstral mean normalization approach. Finally, by using the transformation parameters of the seen handsets to transform the utterances with correctly identified handsets and processing those utterances with unseen handsets by cepstral mean subtraction (CMS), verification error rates are reduced significantly (from 12.41% to 6.59% on average).
Original languageEnglish
Pages (from-to)452-465
Number of pages14
JournalEurasip Journal on Applied Signal Processing
Issue number4
Publication statusPublished - 1 Apr 2004


  • Divergence
  • EM algorithm
  • Feature transformation
  • Handset distortion
  • Robust speaker verification

ASJC Scopus subject areas

  • Signal Processing
  • Hardware and Architecture
  • Electrical and Electronic Engineering


Dive into the research topics of 'Stochastic feature transformation with divergence-based out-of-handset rejection for robust speaker verification'. Together they form a unique fingerprint.

Cite this