Academic Journal of Computing & Information Science, 2024, 7(4); doi: 10.25236/AJCIS.2024.070402.
Menghan Cui
College of Information Engineering, Nanjing University of Finance and Economics, Nanjing, China
The feature selection problem of multi-view data has received widespread attention from researchers in recent years. However, existing multi-view approaches suffer from two main issues in weight optimization: (1) Weight coupling problem, where the weights of different views may be coupled, meaning that changing the weight of one view may affect the weights of other views. In such cases, the weight optimization process may be constrained, leading to suboptimal weight allocation. (2) Lack of handling instability, where some algorithms may not fully consider the instability in the weight optimization process, such as noise and changes in data distribution. This can result in unstable weight selections that cannot cope with uncertain data environments. To address these issues, we propose Weighted Multi-view Feature Selection with Genetic Algorithm (WMFS-GA). Specifically, our algorithm combines feature selection results from multiple views and encodes the selected features as initial features. This enables a more comprehensive utilization of information from multiple views, improving the accuracy and robustness of feature selection. We then employ an improved genetic algorithm for weight optimization, allowing for reasonable weight allocation for features from different views during the feature selection process, enhancing the integration and accuracy of multi-view data. Experimental comparisons with several state-of-the-art multi-view feature selection algorithms demonstrate significant advantages in classification performance for our proposed algorithm. Code for this paper available on: https://github.com/boredcui/WMFS-GA.
Multi-view, Feature selection, Genetic Algorithm
Menghan Cui. Weighted Multi-view Feature Selection with Genetic Algorithm. Academic Journal of Computing & Information Science (2024), Vol. 7, Issue 4: 10-16. https://doi.org/10.25236/AJCIS.2024.070402.
[1] Yu Z, Li L, Xie J, et al. Pedestrian 3D Shape Understanding for Person Re-Identification via Multi-View Learning [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2024.
[2] Hu Y, Wang Y, Li H, et al. Robust multi-view learning via M-estimator joint sparse representation[J]. Pattern Recognition, 2024: 110355.
[3] Sun S, Wang B, Tian Y. Decoupled representation for multi-view learning[J]. Pattern Recognition, 2024: 110377.
[4] Yu Y, Du Z, Meng L, et al. Adaptive online continual multi-view learning[J]. Information Fusion, 2024, 103: 102020.
[5] Khorasani M, Kahani M, Yazdi S A A, et al. Towards finding the lost generation of autistic adults: A deep and multi-view learning approach on social media[J]. Knowledge-Based Systems, 2023, 276: 110724.
[6] Ramírez‐Gallego S, Lastra I, Martínez‐Rego D, et al. Fast‐mRMR: Fast minimum redundancy maximum relevance algorithm for high‐dimensional big data[J]. International Journal of Intelligent Systems, 2017, 32(2): 134-152.
[7] Lambora A, Gupta K, Chopra K. Genetic algorithm-A literature review[C]//2019 international conference on machine learning, big data, cloud and parallel computing (COMITCon). IEEE, 2019: 380-384.
[8] Winn J, Jojic N. Locus: Learning object classes with unsupervised segmentation[C]//Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1. IEEE, 2005, 1: 756-763.
[9] Cao X, Zhang C, Fu H, et al. Diversity-induced multi-view subspace clustering[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2015: 586-594.
[10] Wei H, Chen L, Chen C L P, et al. Fuzzy clustering for multiview data by combining latent information [J]. Applied Soft Computing, 2022, 126: 109140.
[11] Cao Z, Xie X. Structure learning with consensus label information for multi-view unsupervised feature selection [J]. Expert Systems with Applications, 2024, 238: 121893.
[12] Cao Z, Xie X, Sun F, et al. Consensus cluster structure guided multi-view unsupervised feature selection [J]. Knowledge-Based Systems, 2023, 271: 110578.
[13] Fang S G, Huang D, Wang C D, et al. Joint multi-view unsupervised feature selection and graph learning [J]. IEEE Transactions on Emerging Topics in Computational Intelligence, 2023.
[14] Komeili M, Armanfard N, Hatzinakos D. Multiview feature selection for single-view classification [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 43(10): 3573-3586.
[15] Zhang Y, Wu J, Cai Z, et al. Multi-view multi-label learning with sparse feature selection for image annotation [J]. IEEE Transactions on Multimedia, 2020, 22(11): 2844-2857.