Academic Journal of Computing & Information Science, 2026, 9(6); doi: 10.25236/AJCIS.2026.090606.
Ziyan Fu1, Jie Ying1, Jingyun Yang1, Le Fu2
1School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, China
2First Maternity and Infant Hospital, Tongji University, Shanghai, China
Micro-expression recognition plays a significant role in psychological analysis and public safety. To address the challenges of short duration and subtle motion interference in micro-expressions, this paper proposes an Asymmetric Dual-channel Fusion Network (ADF-Net) based on attention mechanisms. The method employs the Convolutional Block Attention Module (CBAM) to adaptively enhance the spatial structural features of static images, integrates Spatial Pyramid Pooling (SPP) to capture multi-scale motion details in dynamic images, and utilizes Squeeze-and-Excitation (SE) attention to achieve adaptive recalibration of dual-channel weights. Experimental results demonstrate that the proposed method achieves UF1 scores of 0.9062, 0.7718, and 0.7099 on the CASME II, SAMM, and SMIC benchmark datasets, with a composite UF1 score of 0.7513 on the 3DB-combined dataset.
Micro-expression Recognition, Dual-channel Network, Dynamic Imaging, Asymmetric Pooling, Attention Mechanism, Feature Fusion
Ziyan Fu, Jie Ying, Jingyun Yang, Le Fu. Micro-Expression Recognition Network Based on Attention Mechanism and Dual-Channel Fusion. Academic Journal of Computing & Information Science (2026), Vol. 9, Issue 6: 37-46. https://doi.org/10.25236/AJCIS.2026.090606.
[1] Ekman P, Friesen W V. Nonverbal leakage and clues to deception[J]. Psychiatry, 1969, 32(1): 88-106.
[2] Zhao G, Pietikainen M. Dynamic texture recognition using local binary patterns with an application to facial expressions[J]. IEEE Trans on pattern analysis and machine intelligence, 2007, 29(6): 915-928.
[3] Liong S T, See J, Wong K S, et al. Less is more: Micro-expression recognition from video using apex frame[J]. Signal Processing: Image Communication, 2018, 62: 82-92.
[4] Li X, Pfister T, Huang X, et al. A spontaneous micro-expression database: Inducement, collection and baseline [C]// The 10th IEEE International Conference and Workshops on Automatic face and gesture recognition (fg). Piscataway, NJ: IEEE Press, IEEE, 2013: 1-6.
[5] Yan W J, Li X, Wang S J, et al. CASME II: An improved spontaneous micro-expression database and the baseline evaluation[J]. PLoS One, 2014, 9(1): e86041.
[6] Davison A K, Lansley C, Costen N, et al. Samm: A spontaneous micro-facial movement dataset[J]. IEEE Trans on affective computing, 2016, 9(1): 116-129.
[7] Van Q N, Chun J, Tokuyama T. CapsuleNet for micro-expression recognition [C]// The 14th IEEE international conference on automatic face & gesture recognition (FG 2019). Piscataway, NJ: IEEE Press, IEEE, 2019: 1-7.
[8] Zhang L, Zhang Y, Sun X, et al. Micro-expression recognition based on direct learning of graph structure[J]. Neurocomputing, 2025, 619: 129135.
[9] Yang J, Wu Z, Wu R. Micro-expression recognition based on contextual transformer networks[J]. The Visual Computer, 2025, 41(3): 1527-1541.
[10] Miao Yuhan, Huang Shucheng. Micro-expression recognition based on Inception-CBAM+ [J]. Computer Applications and Software, 2026, 43(1): 171-177.
[11] Verma M, Vipparthi S K, Singh G, et al. LEARNet: Dynamic imaging network for micro expression recognition[J]. IEEE Trans on Image Processing, 2019, 29: 1618-1627.
[12] He K, Zhang X, Ren S, et al. Deep residual learning for image recognition [C]// Proceedings of the IEEE conference on computer vision and pattern recognition. Piscataway, NJ: IEEE Press, 2016: 770-778.
[13] Li M, Huang X, Wu L. A Semi-Lightweight Multi-Feature Integration Architecture for Micro-Expression Recognition[J]. Computers, Materials & Continua, 2025, 84(1).
[14] Xia Z, Peng W, Khor H Q, et al. Revealing the invisible with model and data shrinking for composite-database micro-expression recognition[J]. IEEE Trans on Image Processing, 2020, 29: 8590-8605.
[15] Wang H, Wang K, Yu W. The dual stream network with embedding temporal convolution for micro-expression recognition[J]. Signal, Image and Video Processing, 2025, 19(5): 403.
[16] Wang G, Huang S. Dual-stream network with cross-layer attention and similarity constraint for micro-expression recognition[J]. Multimedia Systems, 2024, 30(3): 147.
[17] Zhou L, Mao Q, Xue L. Dual-inception network for cross-database micro-expression recognition [C]// The 14th IEEE international conference on automatic face & gesture recognition (FG 2019). Piscataway, NJ: IEEE Press, IEEE, 2019: 1-5.
[18] Zhao S, Tao H, Zhang Y, et al. A two-stage 3D CNN based learning method for spontaneous micro-expression recognition[J]. Neurocomputing, 2021, 448: 276-289.
[19] Woo S, Park J, Lee J Y, et al. Cbam: Convolutional block attention module [C]// Proceedings of the European conference on computer vision (ECCV). Piscataway, NJ: IEEE Press, 2018: 3-19.
[20] Fernando B, Gavves E, Oramas J, et al. Rank pooling for action recognition[J]. IEEE Trans on pattern analysis and machine intelligence, 2016, 39(4): 773-787.
[21] He K, Zhang X, Ren S, et al. Spatial pyramid pooling in deep convolutional networks for visual recognition[J]. IEEE Trans on pattern analysis and machine intelligence, 2015, 37(9): 1904-1916.
[22] Hu J, Shen L, Sun G. Squeeze-and-excitation networks [C]// Proceedings of the IEEE conference on computer vision and pattern recognition. Piscataway, NJ: IEEE Press, 2018: 7132-7141.
[23] See J, Yap M H, Li J, et al. MEGC 2019—the second facial micro-expressions grand challenge [C]// The 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019). Piscataway, NJ: IEEE Press, IEEE, 2019: 1-5.