With the rapid development of deep learning technologies, the integration of fuzzy clustering methods with convolutional autoencoders has offered new perspectives for data clustering. This paper introduces a novel deep learning methodology, "Convolutional Autoencoder-based Deep Embedded Fuzzy Clustering Using H-divergences, (CADEFC)". In response to the rapid evolution of deep learning, this study combines fuzzy clustering methods with convolutional autoencoders to explore new dimensions in data clustering. We critically assess the limitations of the Wasserstein distance as a conventional loss function and propose the adoption of H-divergences as a more robust alternative. By integrating H-divergence and introducing fuzzy theory, our method transcends the traditional constraints of deep clustering techniques, offering substantial improvements in clustering accuracy and stability. The effectiveness and superiority of this approach are demonstrated through rigorous testing on several benchmark datasets, including Digits, Fashion-MNIST, MNIST, and USPS. Our results confirm that the proposed methodology not only enhances performance but also broadens the applicative landscape of deep embedded clustering.

Tianzhen Chen. Convolutional Autoencoder-based Deep Embedded Fuzzy Clustering Using H-divergences. Academic Journal of Computing & Information Science (2024), Vol. 7, Issue 6: 20-31. https://doi.org/10.25236/AJCIS.2024.070604.

[1] Lu, Jie, Guangzhi Ma, and Guangquan Zhang. "Fuzzy Machine Learning: A Comprehensive Framework and Systematic Review." IEEE Transactions on Fuzzy Systems, 2024.

[2] Wei, Xiuxi, et al. "An overview on deep clustering." Neurocomputing, 2024: 127761.

[3] Zhao, Shengjia, et al. "H-divergence: A Decision-Theoretic Probability Discrepancy Measure." IEEE Access, 2020.

[4] Chen, Tianzhen, and Wei Sun. "Deep Convolutional Embedded Fuzzy Clustering with Wasserstein Loss." International Conference on Artificial Intelligence and Big Data in Digital Era. Cham: Springer International Publishing, 2021.

[5] Alqahtani, Ali, et al. "A deep convolutional auto-encoder with embedded clustering." 2018 25th IEE E international conference on image processing (ICIP). IEEE, 2018.

[6] Du, Guowang, et al. "Neighbor-aware deep multi-view clustering via graph convolutional network." Information Fusion, 93, 2023: 330-343.

[7] Tan, Dayu, et al. "Deep adaptive fuzzy clustering for evolutionary unsupervised representation learning." IEEE Transactions on Neural Networks and Learning Systems, 2023.

[8] Bischoff, Sebastian, et al. "A Practical Guide to Statistical Distances for Evaluating Generative Models in Science." arXiv preprint arXiv:2403.12636, 2024.

[9] Cai, Jinyu, et al. "Wasserstein Embedding Learning for Deep Clustering: A Generative Approach." IEEE Transactions on Multimedia, 2024.

[10] Cai, Yuhang, and Lek-Heng Lim. "Distances between probability distributions of different dimensions." IEEE Transactions on Information Theory, 68.6, 2022: 4020-4031.

[11] Li, Yanchun, et al. "The theoretical research of generative adversarial networks: an overview." Neurocomputing, 435, 2021: 26-41.

[12] Shui, Changjian, et al. "Beyond $\mathcal {H} $-Divergence: Domain Adaptation Theory With Jensen-Shannon Divergence." arXiv preprint arXiv:2007.15567, 2020.

[13] Goel, Karan, et al. "Model patching: Closing the subgroup performance gap with data augmentation." arXiv preprint arXiv:2008.06775, 2020.

[14] Rey, Andrea, et al. "Automatic Delineation of Water Bodies in SAR Images with a Novel Stochastic Distance Approach." Remote Sensing, 14.22, 2022: 5716.

[15] Zhao, Shengjia, et al. "Comparing distributions by measuring differences that affect decision making." International Conference on Learning Representations. 2022.

[16] MacQueen, James. "Some methods for classification and analysis of multivariate observations." Proceedings of the fifth Berkeley symposium on mathematical statistics and probability. Vol. 1. No. 14. 1967.

[17] Xie, Junyuan, Ross Girshick, and Ali Farhadi. "Unsupervised deep embedding for clustering analysis." International conference on machine learning. PMLR, 2016.

[18] Guo, Xifeng, et al. "Improved deep embedded clustering with local structure preservation." IJCAI. Vol. 17. 2017.

[19] Guo, Xifeng, et al. "Deep clustering with convolutional autoencoders." Neural Information Processing: 24th International Conference, ICONIP 2017, Guangzhou, China, November 14-18, 2017, Part II 24. Springer International Publishing, 2017.

[20] Feng, Qiying, et al. "Deep fuzzy clustering—a representation learning approach." IEEE Transactions on Fuzzy Systems, 28.7, 2020: 1420-1433.

[21] Diallo, Bassoma, et al. "Deep embedding clustering based on contractive autoencoder." Neurocomputing, 433, 2021: 96-107.