A principled distance-aware uncertainty quantification approach for enhancing the reliability of physics-informed neural network

Jinwu Li, Xiangyun Long, Xinyang Deng, Wen Jiang, Kai Zhou, Chao Jiang, Xiaoge Zhang

Research output: Journal article publicationJournal articleAcademic researchpeer-review

Abstract

Physics-Informed Neural Network (PINN) is a special type of deep learning model that encodes physical laws in the form of partial differential equations as a regularization term in the loss function of neural network. In this paper, we develop a principled uncertainty quantification approach to characterize the model uncertainty of PINN, and the estimated uncertainty is then exploited as an instructive indicator to identify collocation points where PINN produces a large prediction error. To this end, this paper seamlessly integrates spectral-normalized neural Gaussian process (SNGP) into PINN for principled and accurate uncertainty quantification. In the first step, we apply spectral normalization on the weight matrices of hidden layers in the PINN to make the data transformation from input space to the latent space distance-preserving. Next, the dense output layer of PINN is replaced with a Gaussian process to make the quantified uncertainty distance-sensitive. Afterwards, to examine the performance of different UQ approaches, we define several performance metrics tailored to PINN for assessing distance awareness in the measured uncertainty and the uncertainty-informed error detection capability. Finally, we employ three representative physical problems to verify the effectiveness of the proposed method in uncertainty quantification of PINN and compare the developed approach with Monte Carlo (MC) dropout using the developed performance metrics. Computational results suggest that the proposed approach exhibits a superior performance in improving the prediction accuracy of PINN and the estimated uncertainty serves as an informative indicator to detect PINN's prediction failures.

Original languageEnglish
Article number109963
JournalReliability Engineering and System Safety
Volume245
DOIs
Publication statusPublished - May 2024

Keywords

  • Gaussian process
  • Model uncertainty
  • PINN
  • Spectral normalization
  • Uncertainty quantification

ASJC Scopus subject areas

  • Safety, Risk, Reliability and Quality
  • Industrial and Manufacturing Engineering

Fingerprint

Dive into the research topics of 'A principled distance-aware uncertainty quantification approach for enhancing the reliability of physics-informed neural network'. Together they form a unique fingerprint.

Cite this