TY - JOUR
T1 - Multiview high dynamic range image synthesis using fuzzy broad learning system
AU - Guo, Hongbin
AU - Sheng, Bin
AU - Li, Ping
AU - Chen, C. L. Philip
N1 - Funding Information:
Manuscript received March 18, 2019; revised June 24, 2019; accepted August 5, 2019. Date of publication August 30, 2019; date of current version April 15, 2021. This work was supported in part by the National Natural Science Foundation of China under Grant 61872241, Grant 61572316, Grant 61751202, Grant 61751205, Grant 61572540, Grant U1813203, and Grant U1801262, in part by the Macau Science and Technology Development Fund under Grant 0027/2018/A1, Grant 079/2017/A2, Grant 024/2015/AMJ, and Grant 0119/2018/A3, in part by the National Key Research and Development Program of China under Grant 2017YFE0104000 and Grant 2016YFC1300302, and in part by the Science and Technology Commission of Shanghai Municipality under Grant 18410750700, Grant 17411952600, and Grant 16DZ0501100. This article was recommended by Associate Editor C.-F. Juang. (Corresponding author: Bin Sheng.) H. Guo and B. Sheng are with the Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China (e-mail: [email protected]).
Publisher Copyright:
© 2013 IEEE.
PY - 2021/5
Y1 - 2021/5
N2 - Compared with the normal low dynamic range (LDR) images, the high dynamic range (HDR) images provide more dynamic range and image details. Although the existing techniques for generating the HDR images have a good effect for static scenes, they usually produce artifacts on the HDR images for dynamic scenes. In recent years, some learning-based approaches are used to synthesize the HDR images and obtain good results. However, there are also many problems, including the deficiency of explaining and the time-consuming training process. In this article, we propose a novel approach to synthesize multiview HDR images through fuzzy broad learning system (FBLS). We use a set of multiview LDR images with different exposure as input and transfer corresponding Takagi-Sugeno (TS) fuzzy subsystems; then, the structure is expanded in a wide sense in the 'enhancement groups' which transfer from the TS fuzzy rules with nonlinear transformation. After integrating fuzzy subsystems and enhancement groups with the trained-well weight, the HDR image is generated. In FBLS, applying the incremental learning algorithm and the pseudoinverse method to compute the weights can greatly reduce the training time. In addition, the fuzzy system has better interpretability. In the learning process, IF-THEN fuzzy rules can effectively help the model to detect the artifacts and reject them in the final HDR result. These advantages solve the problem of existing deep-learning methods. Furthermore, we set up a new dataset of multiview LDR images with corresponding HDR ground truth to train our system. Our experimental results show that our system can synthesize high-quality multiview HDR images, which has a higher training speed than other learning methods.
AB - Compared with the normal low dynamic range (LDR) images, the high dynamic range (HDR) images provide more dynamic range and image details. Although the existing techniques for generating the HDR images have a good effect for static scenes, they usually produce artifacts on the HDR images for dynamic scenes. In recent years, some learning-based approaches are used to synthesize the HDR images and obtain good results. However, there are also many problems, including the deficiency of explaining and the time-consuming training process. In this article, we propose a novel approach to synthesize multiview HDR images through fuzzy broad learning system (FBLS). We use a set of multiview LDR images with different exposure as input and transfer corresponding Takagi-Sugeno (TS) fuzzy subsystems; then, the structure is expanded in a wide sense in the 'enhancement groups' which transfer from the TS fuzzy rules with nonlinear transformation. After integrating fuzzy subsystems and enhancement groups with the trained-well weight, the HDR image is generated. In FBLS, applying the incremental learning algorithm and the pseudoinverse method to compute the weights can greatly reduce the training time. In addition, the fuzzy system has better interpretability. In the learning process, IF-THEN fuzzy rules can effectively help the model to detect the artifacts and reject them in the final HDR result. These advantages solve the problem of existing deep-learning methods. Furthermore, we set up a new dataset of multiview LDR images with corresponding HDR ground truth to train our system. Our experimental results show that our system can synthesize high-quality multiview HDR images, which has a higher training speed than other learning methods.
KW - Fuzzy broad learning system (FBLS)
KW - High dynamic range (HDR) image
KW - Multiview synthesis
UR - http://www.scopus.com/inward/record.url?scp=85104779952&partnerID=8YFLogxK
U2 - 10.1109/TCYB.2019.2934823
DO - 10.1109/TCYB.2019.2934823
M3 - Journal article
C2 - 31484152
AN - SCOPUS:85104779952
SN - 2168-2267
VL - 51
SP - 2735
EP - 2747
JO - IEEE Transactions on Cybernetics
JF - IEEE Transactions on Cybernetics
IS - 5
ER -