TY - JOUR
T1 - Efficient Depth Intra Frame Coding in 3D-HEVC by Corner Points
AU - Fu, Chang Hong
AU - Chan, Yui Lam
AU - Zhang, Hong Bin
AU - Tsang, Sik Ho
AU - Xu, Meng Ting
N1 - Funding Information:
Manuscript received January 15, 2019; revised January 15, 2020 and August 26, 2020; accepted December 16, 2020. Date of publication December 31, 2020; date of current version January 7, 2021. This work was supported in part by the Research Grants Council of the Hong Kong, SAR, China, under Grant PolyU 152112/17E, in part by the Fundamental Research Funds for the Central Universities under Grant 30917011319, and in part by the National Natural Science Foundation of China under Grant 61301109. The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Ce Zhu. (Corresponding author: Yui-Lam Chan.) Chang-Hong Fu and Hong-Bin Zhang were with the Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hong Kong. They are now with the School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210019, China (e-mail: [email protected]).
Publisher Copyright:
© 1992-2012 IEEE.
PY - 2021/1
Y1 - 2021/1
N2 - To improve the coding performance of depth maps, 3D-HEVC includes several new depth intra coding tools at the expense of increased complexity due to a flexible quadtree Coding Unit/Prediction Unit (CU/PU) partitioning structure and a huge number of intra mode candidates. Compared to natural images, depth maps contain large plain regions surrounded by sharp edges at the object boundaries. Our observation finds that the features proposed in the literature either speed up the CU/PU size decision or intra mode decision and they are also difficult to make proper predictions for CUs/PUs with the multi-directional edges in depth maps. In this work, we reveal that the CUs with multi-directional edges are highly correlated with the distribution of corner points (CPs) in the depth map. CP is proposed as a good feature that can guide to split the CUs with multi-directional edges into smaller units until only single directional edge remains. This smaller unit can then be well predicted by the conventional intra mode. Besides, a fast intra mode decision is also proposed for non-CP PUs, which prunes the conventional HEVC intra modes, skips the depth modeling mode decision, and early determines segment-wise depth coding. Furthermore, a two-step adaptive corner point selection technique is designed to make the proposed algorithm adaptive to frame content and quantization parameters, with the capability of providing the flexible tradeoff between the synthesized view quality and complexity. Simulation results show that the proposed algorithm can provide about 66% time reduction of the 3D-HEVC intra encoder without incurring noticeable performance degradation for synthesized views and it also outperforms the previous state-of-The-Art algorithms in term of time reduction and $\Delta $ BDBR.
AB - To improve the coding performance of depth maps, 3D-HEVC includes several new depth intra coding tools at the expense of increased complexity due to a flexible quadtree Coding Unit/Prediction Unit (CU/PU) partitioning structure and a huge number of intra mode candidates. Compared to natural images, depth maps contain large plain regions surrounded by sharp edges at the object boundaries. Our observation finds that the features proposed in the literature either speed up the CU/PU size decision or intra mode decision and they are also difficult to make proper predictions for CUs/PUs with the multi-directional edges in depth maps. In this work, we reveal that the CUs with multi-directional edges are highly correlated with the distribution of corner points (CPs) in the depth map. CP is proposed as a good feature that can guide to split the CUs with multi-directional edges into smaller units until only single directional edge remains. This smaller unit can then be well predicted by the conventional intra mode. Besides, a fast intra mode decision is also proposed for non-CP PUs, which prunes the conventional HEVC intra modes, skips the depth modeling mode decision, and early determines segment-wise depth coding. Furthermore, a two-step adaptive corner point selection technique is designed to make the proposed algorithm adaptive to frame content and quantization parameters, with the capability of providing the flexible tradeoff between the synthesized view quality and complexity. Simulation results show that the proposed algorithm can provide about 66% time reduction of the 3D-HEVC intra encoder without incurring noticeable performance degradation for synthesized views and it also outperforms the previous state-of-The-Art algorithms in term of time reduction and $\Delta $ BDBR.
KW - 3D-HEVC
KW - corner detection
KW - depth map
KW - depth modeling mode
KW - intra coding
KW - multi-view video plus depth
UR - http://www.scopus.com/inward/record.url?scp=85099085674&partnerID=8YFLogxK
U2 - 10.1109/TIP.2020.3046866
DO - 10.1109/TIP.2020.3046866
M3 - Journal article
AN - SCOPUS:85099085674
SN - 1057-7149
VL - 30
SP - 1608
EP - 1622
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
M1 - 9311748
ER -