article

Fast intra mode decision for depth coding in 3D-HEVC

Authors:

Yongshuang Yang,

Yong GanAuthors Info & Claims

Multidimensional Systems and Signal Processing, Volume 28, Issue 4

Pages 1203 - 1226

https://doi.org/10.1007/s11045-016-0388-1

Published: 01 October 2017 Publication History

Abstract

The emergent 3D High Efficiency Video Coding (3D-HEVC) is an extension of the High Efficiency Video Coding (HEVC) standard for the compression of the multi-view texture videos plus depth maps format. Since depth maps have different statistical properties compared to texture video, various new intra tools have been added to 3D-HEVC depth coding. In current 3D-HEVC, new intra tools are utilized together with the conventional HEVC intra prediction modes for depth coding. This technique achieves the highest possible coding efficiency, but leads to an extremely high computational complexity which limits 3D-HEVC from practical applications. In this paper, we propose a fast intra mode decision algorithm for depth coding in 3D-HEVC. The basic idea of the proposed algorithm is to utilize the depth map characteristics to predict the current depth prediction mode and skip some specific depth intra modes rarely used in 3D-HEVC depth coding. Based on this analysis, two fast intra mode decision strategies are proposed including reduction of the number of conventional intra prediction modes, and simplification of depth modeling modes (DMMs). Experimental results demonstrate that the proposed algorithm can save 30 % coding runtime on average while maintaining almost the same rate-distortion (RD) performance as the original 3D-HEVC encoder.

References

[1]

Bjontegaard, G. (2001). Calculation of average PSNR difference between RD-curves, 13th VCEG Meeting, Doc. VCEG-M33, Austin, TX.

[2]

Cernigliaro, G., Jaureguizar, F., Cabrera, J., & García, N. (2013). Low complexity mode decision and motion estimation for H.264/AVC based depth maps encoding in free viewpoint video. IEEE Transactions on Circuits and Systems for Video Technology, 23(5), 769-783.

Digital Library

[3]

Chen, Y., Tech, G., Wegner, K. & Yea, S. (2014). Test Model 10 of 3D-HEVC and MV-HEVC, Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) document JCT3V-J1003, 10thMeeting: Strasbourg, FR.

[4]

Chen, Y., Hannuksela, M. M., Suzuki, T., & Hattori, S. (2014). Overview of the MVC + D 3D video coding standard. Journal of Visual Communication and Image Representation, 25(4), 679-688.

Digital Library

[5]

Chen, Y., & Vetro, A. (2014). Next-Generation 3D formats with depth map support. IEEE MultiMedia, 21(2), 90-94.

[6]

Fehn, C., & Fehn, C. (2004). Depth-Image-Based Rendering (DIBR), Compression, and Transmission for a New Approach on 3D-TV. Bellingham, WA: SPIE.

[7]

Gu, Z., Zheng, J., Ling, N., & Zhang, P. (2013). Fast depth modeling mode selection for 3D HEVC depth intra coding. In Proceedings 2013 IEEE International Conference on Multimedia and Expo Workshops (pp. 1-4).

[8]

Gu, Z., Zheng, J., Ling, N., & Zhang, P. (2014). Fast bi-partition mode selection for 3D HEVC depth intra coding. In Proceedings 2014 IEEE International Conference on Multimedia and Expo (ICME) (pp. 1-6).

[9]

https://hevc.hhi.fraunhofer.de/svn/svn_3DVCSoftware/branches/HTM-DEV-2.0-dev0/cfg/3D-HEVC/

[10]

Lainema, J., Bossen, F., Han, W.-J., Min, J., & Ugur, K. (2012). Intra coding of the HEVC standard. IEEE Transactions on Circuits and Systems for Video Technology, 22(12), 1792-1801.

Digital Library

[11]

Lee, J. Y., Wey, H.-C., & Park, D.-S. (2011). A fast and efficient multi-view depth image coding method based on temporal and inter-view correlations of texture images. IEEE Transactions on Circuits and Systems for Video Technology, 21(12), 1859-1868.

[12]

Lei, J., Li, S., Zhu, C., Sun, M., & Hou, C. (2015). Depth coding based on depth-texture motion and structure similarities. IEEE Transactions on Circuits and Systems for Video Technology, 25(2), 275-286.

[13]

Lei, J., Sun, J., Pan, Z., Kwong, S., Duan, J., & Hou, C. (2015). Fast mode decision using inter-view and intercomponent correlations for multiview depth video coding. IEEE Transactions on Industrial Informatics, 11(4), 978-986.

[14]

Merkle, P., & Müller, K. (2014). CE5 related: DMM1 signaling based onintra direction, Joint Collaborative Team on 3D Video CodingExtensions (JCT-3V) document JCT3V-G0108, 7th Meeting: San José, US (pp. 11-17).

[15]

Mueller, K., & Vetro, A. (2014). Common test conditions of 3DV core experiments, Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) document JCT3V-G1100, 7th Meeting: San José, US.

[16]

Müller, K., Merkle, P., & Wiegand, T. (2011). 3-D video representation using depth maps. Proceedings of the IEEE, 99(4), 643-656.

[17]

Müller, K., Schwarz, H., Marpe, D., Bartnik, C., Bosse, S., Brust, H., et al. (2013). 3D high efficiency video coding for multi-view video and depth data. IEEE Transactions on Image Processing, 22(9), 3366-3378.

Digital Library

[18]

Pan, Z., Kwong, S., Sun, M., & Lei, J. (2014). Early MERGE mode decision based on motion estimation and hierarchical depth correlation for HEVC. IEEE Transactions on Broadcasting, 60(2), 405-412.

[19]

Park, C. (2015). Edge-based intramode selection for depth-map coding in 3D-HEVC. IEEE Transactions on Image Processing, 24(1), 155-162.

[20]

Sanchez, G., Saldanha, M., Balota, G., Zatt, B., Porto, M., & Agostini, L. (2014). A complexity reduction algorithm for depth maps intra prediction on the 3D-HEVC. In Proceedings 2014 IEEE Visual Communications and Image Processing Conference (VCIP) (pp. 137-140).

[21]

Sanchez, G., Saldanha, M., Balota, G., Zatt, B., Porto, M., & Agostini, L. (2014). Complexity reduction for 3D-HEVC depth maps intra-frame prediction using simplified edge detector algorithm. In Proceedings 2014 IEEE International Conference on Image Processing (ICIP) (pp. 3209-3213).

[22]

Shen, L., Zhang, Z., & Liu, Z. (2012). Inter mode selection for depth map coding in 3D video. IEEE Transactions on Consumer Electronics, 58(3), 1857-1865.

[23]

Shen, L., An, P., Liu, Z., & Zhang, Z. (2014). Low complexity depth coding assisted by coding information from color video. IEEE Transactions on Broadcasting, 60(1), 128-133.

[24]

Shen, L., An, P., Zhang, Z., Hu, Q., & Chen, Z. (2015). A 3D-HEVC fastmode decision algorithm for real time applications. ACM Transactions on Multimedia Computing, Communications, and Applications, 11(3), 34.

[25]

Shen, L., & Zhang, Z. (2014). Efficient depth coding in 3D video to minimize coding bitrate and complexity. Multimedia Tools and Applications, 72(2), 1639-1652.

Digital Library

[26]

Song, Y., & Ho, Y. (2013). Simplified inter-component depth modeling in 3D-HEVC. In Proceedings IEEE 11th IVMSP Workshop (pp. 1-4).

[27]

Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012). Overview of the high efficiency video coding (HEVC) standard. IEEE Transactions on Circuits and Systems for Video Technology, 22(12), 1649-1668.

Digital Library

[28]

Sullivan, G., Boyce, J., Chen, Y., Ohm, J.-R., Segall, C., & Vetro, A. (2013). Standardized extensions of high efficiency video coding (HEVC). IEEE Journal of Selected Topics in Signal Processing, 7(6), 1001-1016.

[29]

Tanimoto, M., Fujii, T., & Suzuki, K. (2008). View Synthesis Algorithmin View Synthesis Reference Software 2.0 (VSRS 2.0), ISO/IEC JTC1/SC29/WG11 M16090, Lausanne, Switzerland.

[30]

Vetro, Anthony., & Müller, Karsten. (2012). Description of Coreexperiments in 3D video coding, ISO/IEC JTC1/SC29/WG11 document W12746, Geneva, Switzerland.

[31]

Vetro, A., & Müller, K. (2012). Description of Core experiments in 3Dvideo coding, ISO/IEC JTC1/SC29/WG11 document W12746, Geneva, Switzerland.

[32]

Wang, M., Jin, X., & Goto, S. (2010). Difference detection based early mode termination for depthmap coding in MVC. In Proceedings 28th Picture Coding Symposium (pp. 502-505).

[33]

Yoon, D. H., & Ho, Y. S. (2011). Fast mode decision algorithm for depth coding in 3-D video systems using H.264/AVC. In Proceedings 5th Pacific-Rim Symposium Image Video Technology (pp. 25-35).

[34]

Zeng, H., Wang, Y., Wei, Z., & Cai, C. (2014). Efficient two-stage early SKIP mode termination for depth video coding. Computers and Electrical Engineering, 40(4), 1344-1352.

Digital Library

[35]

Zhang, M., Zhao, C., Xu, J., & Bai, H. (2013). A fast depth-map wedgelet partitioning scheme for intra prediction in 3D video coding. In Proceedings IEEE International Symposium on Circuits and Systems(ISCAS) (pp. 2852-2855).

[36]

Zhang, Q., An, P., Zhang, Y., Shen, L., & Zhang, Z. (2011). Low complexity multiview video plus depth coding. IEEE Transactions on Consumer Electronics, 57(4), 1857-1865.

[37]

Zhang, Q., Li, N., Huang, L., & Gan, Y. (2014). Effective early termination algorithm for depth map intra coding in 3D-HEVC. Electronics Letters, 50(14), 994-996.

[38]

Zhang, Q., Wu, Q., Wang, X., & Gan, Y. (2014). Early SKIP mode decision for three-dimensional high efficiency video coding using spatial and interview correlations. Journal of Electronic Imaging, 23(5), 053017-1-053017-8.

Cited By

Hamout HElyousfi A(2020)Fast Depth Map Intra Coding for 3D Video Compression-Based Tensor Feature Extraction and Data AnalysisIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2019.291877030:7(1933-1945)Online publication date: 1-Jul-2020
https://dl.acm.org/doi/10.1109/TCSVT.2019.2918770
Sanchez GAgostini LSousa LMarcon C(2020)Parallelism exploration for 3D high-efficiency video coding depth modeling mode oneJournal of Real-Time Image Processing10.1007/s11554-018-0819-317:4(787-797)Online publication date: 1-Aug-2020
https://dl.acm.org/doi/10.1007/s11554-018-0819-3
El-Bakary EEl-Shafai WEl-Rabaie SZahran OEl-Halawany MAbd El-Samie F(2019)Proposed enhanced hybrid framework for efficient 3D-MVC and 3D-HEVC wireless communicationMultimedia Tools and Applications10.1007/s11042-018-6765-z78:11(14173-14193)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1007/s11042-018-6765-z
Show More Cited By

Fast intra mode decision for depth coding in 3D-HEVC
1. Computing methodologies
  1. Computer graphics

Recommendations

Fast mode decision algorithm for 3D-HEVC encoding optimization based on depth information

The advanced 3D extension of the High Efficiency Video Coding standard (3D-HEVC) encodes 3D videos in the multi-view video plus depth format (MVD) and introduces new prediction modes to improve the coding performance of dependent views and depth data. ...
Fast Depth Intra Mode Decision Based on DCT in 3D-HEVC
Pattern Recognition and Computer Vision
Abstract
The state-of-the-art 3D High Efficiency Video Coding (3D-HEVC) is an extension of the High Efficiency Video Coding (HEVC) standard dealing with the multi-view texture videos plus depth map format. But current 3D-HEVC with all intra mode prediction ...
Fast depth map mode decision based on depthtexture correlation and edge classification for 3D-HEVC

A fast depth map mode decision algorithm for 3D-HEVC is proposed.The depth map-texture video correlation is exploited throughout fast mode detection.The edge classification is employed in the procedure of intra/inter prediction.Experimental results ...

Comments

Information & Contributors

Information

Published In

cover image Multidimensional Systems and Signal Processing

Multidimensional Systems and Signal Processing Volume 28, Issue 4

October 2017

633 pages

ISSN:0923-6082

Issue’s Table of Contents

Copyright © Copyright © 2017 Springer Science+Business Media, LLC.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 October 2017

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hamout HElyousfi A(2020)Fast Depth Map Intra Coding for 3D Video Compression-Based Tensor Feature Extraction and Data AnalysisIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2019.291877030:7(1933-1945)Online publication date: 1-Jul-2020
https://dl.acm.org/doi/10.1109/TCSVT.2019.2918770
Sanchez GAgostini LSousa LMarcon C(2020)Parallelism exploration for 3D high-efficiency video coding depth modeling mode oneJournal of Real-Time Image Processing10.1007/s11554-018-0819-317:4(787-797)Online publication date: 1-Aug-2020
https://dl.acm.org/doi/10.1007/s11554-018-0819-3
El-Bakary EEl-Shafai WEl-Rabaie SZahran OEl-Halawany MAbd El-Samie F(2019)Proposed enhanced hybrid framework for efficient 3D-MVC and 3D-HEVC wireless communicationMultimedia Tools and Applications10.1007/s11042-018-6765-z78:11(14173-14193)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1007/s11042-018-6765-z
El-Bakary EEl-Shafai WEl-Rabaie SZahran OAbd El-Samie F(2019)Efficient hybrid framework for transmission enhancement of composite 3D H.264 and H.265 compressed video framesMultimedia Tools and Applications10.1007/s11042-018-6464-978:9(11337-11368)Online publication date: 1-May-2019
https://dl.acm.org/doi/10.1007/s11042-018-6464-9
Zhang MLai DLiu ZAn C(2019)A novel adaptive fast partition algorithm based on CU complexity analysis in HEVCMultimedia Tools and Applications10.1007/s11042-018-6105-378:1(1035-1051)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1007/s11042-018-6105-3

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents