A Power Penalty Method for Discrete HJB Equations

Kai Zhang, Xiaoqi Yang

Research output: Journal article publicationJournal articleAcademic researchpeer-review

2 Citations (Scopus)


We develop a power penalty approach to the discrete Hamilton–Jacobi–Bellman (HJB) equation in RN in which the HJB equation is approximated by a nonlinear equation containing a power penalty term. We prove that the solution to this penalized equation converges to that of the HJB equation at an exponential rate with respect to the penalty parameter when the control set is finite and the coefficient matrices are M-matrices. Examples are presented to confirm the theoretical findings and to show the efficiency of the new method.

Original languageEnglish
Pages (from-to)1419-1433
Number of pages15
JournalOptimization Letters
Issue number6
Publication statusPublished - 1 Sept 2020


  • Convergence rate
  • HJB equation
  • Penalty method

ASJC Scopus subject areas

  • Control and Optimization


Dive into the research topics of 'A Power Penalty Method for Discrete HJB Equations'. Together they form a unique fingerprint.

Cite this