A new QR decomposition-based RLS algorithm using the split Bregman method for L1-regularized problems

Y. J. Chu, Cheuk Ming Mak

Research output: Journal article publicationJournal articleAcademic researchpeer-review

11 Citations (Scopus)

Abstract

The split Bregman (SB) method can solve a broad class of L1-regularized optimization problems and has been widely used for sparse signal processing in a variety of applications. To achieve lower complexity and to cope with time-varying environments, we develop a new adaptive version of the SB method for finding online sparse solutions. This algorithm is derived from the recursive least squares (RLS) optimization problem, where the SB method is used to separate the regularization term from the constrained optimization. This algorithm is numerically more stable and easily amenable to multivariate implementation due to the use of a QR decomposition (QRD) structure. An efficient method is further developed for selecting the thresholding rule, which controls the sparsity level of the estimator. Moreover, the SB-QRRLS algorithm is extended to a multivariate version to solve the sparse principal component analysis (SPCA) problem. Simulation results are presented to illustrate the effectiveness of the proposed algorithms in sparse system estimation and SPCA. We show that the convergence and tracking performance of the proposed algorithms compares favorably with conventional algorithms.
Original languageEnglish
Pages (from-to)303-308
Number of pages6
JournalSignal Processing
Volume128
DOIs
Publication statusPublished - 1 Nov 2016

Keywords

  • L regularization 1
  • Recursive least squares (RLS)
  • Sparse principal component analysis (SPCA)
  • Split Bregman (SB)

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Cite this