Academic Journal of Computing & Information Science, 2023, 6(8); doi: 10.25236/AJCIS.2023.060802.
Duo Hao1, Wencong Shi1, Chengwei Li2, Fenghuan Fan1
1Department of Electronic Information and Control Engineering, North China Institute of Aerospace Engineering, Hebei, Langfang, China
2School of Instrument Science and Engineering, Harbin Institute of Technology, Heilonjiang, Harbin, China
Unintentional motions often cause cameras to produce shaky images, which is a significant source of inter-frame blur and video quality decline. To ad-dress this issue, we present a digital image stabilization approach based on variational mode decomposition (VMD) and sampling fluctuation analysis (SFA) to generate stable video sequences. Our method first estimates the global motion vector (GMV) from a video sequence using the speeded up robust features (SURF) algorithm. We then decompose the GMV into various modes using VMD to separate jitter motions from intentional ones. Here, SFA is applied to distinguish different modes based on their unique structural characteristics. We evaluate our proposed method in complex scenarios by comparing it with several existing methods. Our experimental results demonstrate that VMD outperforms other stabilization techniques under comparable conditions.
digital image stabilization, variational mode decomposition, sampling fluctuation analysis, global motion vector sequence
Duo Hao, Wencong Shi, Chengwei Li, Fenghuan Fan. Digital image stabilization method based on variational mode decomposition and sampling fluctuation analysis. Academic Journal of Computing & Information Science (2023), Vol. 6, Issue 8: 8-21. https://doi.org/10.25236/AJCIS.2023.060802.
[1] Zhang Ning, Yang Yuan, Wu Jianhua, Zhao Ziqian, Yin Guodong. Vehicular Electronic Image Stabilization System Based on a Gasoline Model Car Platform [J]. Chinese Journal of Mechanical Engineering, 2022, 35(1).
[2] Qin Shumin, Zhao Lizhen, Tian Xingke, Li Lidan, Liu Shuyun. Research on Electronic Image Stabilization Technology of Vehi-cle-Mounted Remote-Controlled Weapon Station[J]. Journal of Physics: Conference Series, 2021, 2083(3).
[3] N. Zhang, H. B. Zhang, J. H. Wu, Y. Yang, G. D. Yin. An Electronic Image Stabilization Algorithm for Vision System of Intelligent Vehicles [J]. Journal of Tongji University, 2022, 50(04):497-503.
[4] Mingyuan Fan, Ziyuan Tong, Shoufeng Tang, Minming Tong, Bo Wang. Research of Digital Image Stabilization on Airborne Video [J]. IOP Conference Series: Materials Science and Engineering, 2018, 381(1).
[5] Duo Hao, Qiuming Li, Chengwei Li. Digital Image Stabilization Method Based on Variational Mode Decomposition and Relative Entropy [J]. Entropy, 2017, 19(11).
[6] Meguro M, Taguchi A, Hamada N. Data-dependent weighted average filtering for image sequence restoration [J]. Electronics and Communicat-ions in Japan (Part III Fundamental Electronic Science), 2001, 84 (4): 1-10.
[7] J. L. Wang. Wavelet analysis of volatile organic compounds in the atmosphere [J]. Cleaning World, 2022, 38(09):60-62.
[8] B. You, C. F. Zhang. Image denoising based on wavelet adaptive threshold and bilateral filtering [J]. Computer Engineering and Design, 2019, 40(08):2278-2282.
[9] K. Ioannidis and I. Andreadis, “A digital image stabilization methodbased on the Hilbert– Huang transform,” IEEE Trans. Instrum. Meas. 61(9), 2446– 2457 (2012).
[10] Z. Wu and N. E. Huang, “Ensemble empirical mode decomposition: a noise-assisted data analysis method, ” Adv. Adapt. Data Anal. 1, 1– 41(2009).
[11] J. -R. Yeh, J. -S. Shieh, and N. E. Huang, “Complementary ensembleempirical mode decomposition: a novel noise enhanced data analysismethod,” Adv. Adapt. Data Anal. 2, 135– 156 (2010).
[12] M. E. Torres et al., “A complete ensemble empirical mode decompo-sition with adaptive noise,” in Proc. of 2011 IEEE Int. Conf. on Acoustics, Speech and Signal, pp. 4144– 4147 (2011).
[13] Y. Y. Zou, Z. L. Yang, L. D. Yang. Image matching algorithm based on improved SURF [J/OL] Computer Systems & Applica-tions: 1-7[2022-12-04].
[14] Li Xiaoguang, Zhu Juan, Ruan Yiming. Vehicle Seat Detection Based on Improved RANSAC-SURF Algorithm [J]. International Journal of Pattern Recognition and Artificial Intelligence, 2021, 35(05).
[15] Bay H, Ess A, Tuytelaars T, et al. Speeded-Up Robust Features (surf) [J]. Computer Vision & Image Understanding, 2008, 110 (3): 346-359.
[16] Ahmed Aldahdooh, Enrico Masala, Glenn Van Wallendael. Framework for reproducible objective video quality research with case study on PSNR implementations [J]. Digital Signal Processing. June 2018, 77: 195-206.
[17] Kamble V. B.; Deshmukh S. N. Comparision between Accuracy and MSE, RMSE by Using Proposed Method with Imputation Technique. Oriental Journal of Computer Science and Technology. 2017, 10: 773-779.
[18] Cui, J . W.;Wang, D. Q. ;Liu. J. Y.; Single Image Dehazing Algorithm Based on Average Filtering and Wavelet Transform. Com-puter & Digital Engineering. 2022(06).
[19] Shaikh, W A. Shah S F, et al. Pandhiani Siraj Muhammad; A hybrid forecasting model based on the group method of data handling and wavelet decomposition for monthly rivers streamflow data sets. Open Physics. 2022. PP 1096-1111
[20] Markus G; Patrik Z, et al. Improved EMD-based Oscillation Detection for Mechatronic Closed-Loop Systems. IFAC-Papers On Line 2019. PP 370-375.
[21] Wang, K J. Xiong, X Y. Ren, Z. Highly efficient mean filtering algorithm. Application Research of Computers. 2010(02).
[22] Q. Wang, X. Chen. Selection of wavelet bases in wavelet analysis of microseismic signals of rock fractur [J]. Electronic Design Engineering., 2016, 24(21):126-128+131.