Welcome to Francis Academic Press

Academic Journal of Engineering and Technology Science, 2020, 3(2); doi: 10.25236/AJETS.2020.030210.

Fast Intra Mode Coding Based on Convolutional Neural Network


Chengsi Lin*, Qingming Yi

Corresponding Author:
Chengsi Lin

School of information science and technology, Jinan University, Guangzhou 510632
*Corresponding author e-mail: [email protected]


In order to better adapt to the different texture features of video images, the number of intra coding modes in the new generation of video coding standard h.265/HEVC (high efficiency video coding) has increased to 35, which not only achieves better coding performance but also increases the computational complexity. In order to reduce the complexity of intra coding, a fast intra prediction method based on convolutional neural network (CNN) is proposed. For 4x4 or 8x8 PU, this paper gets the list of candidate modes by CNN, skipping the rough mode decision (RMD) process of prediction unit (PU). In this paper, the algorithm is embedded in HEVC coding framework, which effectively reduces the redundant intra prediction process in all intra configuration. The experimental results show that compared with HEVC official test model (HM16.12), the coding time of the algorithm proposed in this paper is reduced by 28.08% on average, while that of BD_BR and BD_PSNR is only 1.14% and - 0.055db.


High Efficiency Video Coding (HEVC), Intra Prediction, Deep Learning, CNN

Cite This Paper

Chengsi Lin, Qingming Yi. Fast Intra Mode Coding Based on Convolutional Neural Network. Academic Journal of Engineering and Technology Science (2020) Vol. 3 Issue 2: 73-82. https://doi.org/10.25236/AJETS.2020.030210.


[1] Sullivan G J, Ohm J, Han W, et al. Overview of the High Efficiency Video Coding (HEVC) Standard [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22 (12): 1649-1668.
[2] Ohm J R, Sullivan G J, Schwarz H, et al. Comparison of the coding efficiency of video coding standards-including high efficiency video coding (HEVC) [J].IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22 (12): 1669-1684.
[3] JCT-VC, “HM Software”. [CP/OL]. Available: https:// hevc. hhi.fraunhofer. de/ svn/ svn_HE-VCSoftware/tags/HM-16.12/.
[4] Lainema J, Bosssen F, Han W J, et al. Intra Coding of the HEVC standard [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22 (12): 1792-1801.
[5] Jiang W, Ma H J, Chen Y W. Gradient based fast mode decision algorithm for intra prediction in HEVC [C]// 2012 2nd International Conference on Consumer Electronics, Communications and Networks (CECNet), Yichang, 2012: 1836-1840.
[6] Liao W H, Yang D Q, Chen Z Z. A Fast Mode Decision Algorithm for HEVC Intra Prediction [C]// 2016 Visual Communications and Image Processing (VCIP), Chengdu, 2016: 1-4.
[7] G. Chen, Z. Liu, T. Ikenaga and D. Wang, "Fast HEVC intra mode decision using matching edge detector and kernel density estimation alike histogram generation,"2013 IEEE International Symposium on Circuits and Systems (ISCAS), Beijing, 2013, pp. 53-56.
[8] T. L. da Silva, L. V. Agostini and L. A. da Silva Cruz, "Fast HEVC intra prediction mode decision based on EDGE direction information," 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO), Bucharest, 2012, pp. 1214-1218.
[9] Yi Q, Xie Z, Shi M. A fast decision-making algorithm for HEVC intra coding [J]. Journal of Chinese Computer Systems, 2019, 40 (01): 199-204. http:// kns.cnki.net/kcms/detail/detail.aspx?FileName=XXWX201901039&DbName=CJFQ2019
[10] A. Heindel, C. Pylinski and A. Kaup, "Two-stage exclusion of angular intra prediction modes for fast mode decision in HEVC," 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, 2016, pp. 529-533.
[11] N. Song, Z. Liu, X. Ji and D. Wang, "CNN oriented fast PU mode decision for HEVC hardwired intra encoder," 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP), Montreal, QC, 2017, pp. 239-243.
[12] Zhu S P, Zhang C Y. A Fast Algorithm of Intra Prediction Modes Pruning for HEVC Based on Decision Trees and A New Three-Step Search [J]. Multimedia Tools and Applications, Springer, 2017, 76 (20): 21707-21728.
[13] Bossen F, Common test conditions and software reference configurations, JCTVC-L1100, in: 12TH JCT-VC meeting, Geneva, CH, January 2013: 1-4.
[14] Bjøntegaard G. Calculation of Average PSNR Differences between R-D curves [J]. ITU-T VCEG, 13th Meeting, 2001.