TY - GEN
T1 - From Synthetic to Real
T2 - 29th ACM International Conference on Multimedia, MM 2021
AU - Liu, Ye
AU - Zhu, Lei
AU - Pei, Shunda
AU - Fu, Huazhu
AU - Qin, Jing
AU - Zhang, Qing
AU - Wan, Liang
AU - Feng, Wei
N1 - Funding Information:
This work presents a disentangled-consistency mean teacher network (DMT-Net) for boosting single-image dehazing by leveraging feature disentangled learning and unlabeled real-world images. Our key idea is to first disentangle features from input hazy photos for simultaneously predicting clean images, transmission maps, and atmospheric images, for which we develop a disentangled image de-hazing network (DID-Net) following a coarse-to-fine strategy. Then we assign DID-Net as the student and teacher networks to impose disentangled consistency loss for leveraging additional unlabeled data. Experimental results on synthesized datasets and real-world photos demonstrate the effectiveness of our network, which clearly outperforms the state-of-the-art image dehazing methods. Acknowledgments: The work is supported by the National Natural Science Foundation of China (Grant No. 61902275), the research fund for The Tianjin Key Lab for Advanced Signal Processing, Civil Aviation University of China (Grant No. 2019AP-TJ01), and a grant under Innovation and Technology Fund - Midstream Research Programme for Universities (ITF-MRP) (Project no. MRP/022/20X).
Publisher Copyright:
© 2021 ACM.
PY - 2021/10/17
Y1 - 2021/10/17
N2 - Single image dehazing is a challenging task, for which the domain shift between synthetic training data and real-world testing images usually leads to degradation of existing methods. To address this issue, we propose a novel image dehazing framework collaborating with unlabeled real data. First, we develop a disentangled image dehazing network (DID-Net), which disentangles the feature representations into three component maps, i.e. the latent haze-free image, the transmission map, and the global atmospheric light estimate, respecting the physical model of a haze process. Our DID-Net predicts the three component maps by progressively integrating features across scales, and refines each map by passing an independent refinement network. Then a disentangled-consistency mean-teacher network (DMT-Net) is employed to collaborate unlabeled real data for boosting single image dehazing. Specifically, we encourage the coarse predictions and refinements of each disentangled component to be consistent between the student and teacher networks by using a consistency loss on unlabeled real data. We make comparison with 13 state-of-the-art dehazing methods on a new collected dataset (Haze4K) and two widely-used dehazing datasets (i.e., SOTS and HazeRD), as well as on real-world hazy images. Experimental results demonstrate that our method has obvious quantitative and qualitative improvements over the existing methods.
AB - Single image dehazing is a challenging task, for which the domain shift between synthetic training data and real-world testing images usually leads to degradation of existing methods. To address this issue, we propose a novel image dehazing framework collaborating with unlabeled real data. First, we develop a disentangled image dehazing network (DID-Net), which disentangles the feature representations into three component maps, i.e. the latent haze-free image, the transmission map, and the global atmospheric light estimate, respecting the physical model of a haze process. Our DID-Net predicts the three component maps by progressively integrating features across scales, and refines each map by passing an independent refinement network. Then a disentangled-consistency mean-teacher network (DMT-Net) is employed to collaborate unlabeled real data for boosting single image dehazing. Specifically, we encourage the coarse predictions and refinements of each disentangled component to be consistent between the student and teacher networks by using a consistency loss on unlabeled real data. We make comparison with 13 state-of-the-art dehazing methods on a new collected dataset (Haze4K) and two widely-used dehazing datasets (i.e., SOTS and HazeRD), as well as on real-world hazy images. Experimental results demonstrate that our method has obvious quantitative and qualitative improvements over the existing methods.
KW - feature disentangling
KW - single image dehazing
KW - unlabeled real data
UR - http://www.scopus.com/inward/record.url?scp=85119340468&partnerID=8YFLogxK
U2 - 10.1145/3474085.3475331
DO - 10.1145/3474085.3475331
M3 - Conference article published in proceeding or book
AN - SCOPUS:85119340468
T3 - MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia
SP - 50
EP - 58
BT - MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia
PB - Association for Computing Machinery, Inc
Y2 - 20 October 2021 through 24 October 2021
ER -