Welcome to Francis Academic Press

Academic Journal of Engineering and Technology Science, 2024, 7(5); doi: 10.25236/AJETS.2024.070507.

Self-adaptive Differential Evolution for Multi-objective Optimization with Local Search and Indicator-based Selection

Author(s)

Datong Xie1,2

Corresponding Author:
Datong Xie
Affiliation(s)

1School of Information Engineering, Fujian Business University, Fuzhou, China

2Engineering Research Center of Big Data Business Intelligence, Fujian Province University, Fuzhou, China

Abstract

Differential Evolution (DE) is an evolutionary algorithm that has become increasingly popular due to its effectiveness and efficiency. However, its adaptation for multi-objective optimization requires further investigation. To address this issue, a novel algorithm called ILSDEMO has been proposed, which incorporates indicator-based selection and local search into a self-adaptive DE. ILSDEMO employs an archive population to store non-dominated solutions, generating an initial population uniformly distributed over the feasible solution space using orthogonal design. Additionally, two variants of DE are used to expedite convergence, while q-Gaussian mutation is utilized to exploit better trial individuals. The k-nearest neighbor rule is used to eliminate crowded solutions, and indicator-based selection is employed to generate a new parent population without diversity preservation. The performance of ILSDEMO was investigated on the test instances from the ZDT series and DTLZ series in terms of the selected indicators. The results suggest that ILSDEMO accurately and evenly approximates the true Pareto front compared to NSGAII, IBEA, and DEMO.

Keywords

Multi-objective Optimization, Self-adaptive Differential Evolution, Orthogonal Design, Indicator-based Selection, Local Search, K-nearest Neighbor

Cite This Paper

Datong Xie. Self-adaptive Differential Evolution for Multi-objective Optimization with Local Search and Indicator-based Selection. Academic Journal of Engineering and Technology Science (2024) Vol. 7, Issue 5: 43-58. https://doi.org/10.25236/AJETS.2024.070507.

References

[1] Price, K., Storn, R., Lampinen, J. Differential evolution: a practical approach to global optimiza-tion. Springer-Verlag: Heidelberg, Germany, 2005.

[2] Mezura-Montes, E., Reyes-Sierra, M., Coello Coello, CA. Multi-Objective Optimization using Dif-ferential Evolution: A Survey of the State-of-the-Art. Advances in Differential Evolution. Spring-er-Verlag: Heidelberg, Germany, 2008.

[3] Mezura-Montes, E., Velázquez-Reyes, J., Coello Coello, C.A. A comparative study of differential evolution variants for global optimization. In Proceedings of the 8th annual conference on Genetic and evolutionary computation (GECCO2006), pp. 485-492, Seattle, USA, 8-12 July 2006.

[4] Wang, S., Zhou, A., Li, B., et al. Differential evolution guided by approximated Pareto set for mul-tiobjective optimization. Information Sciences, 2023, 630, 669-687.

[5] Liang, J., Lin, H., Yue, C., et al. Multiobjective Differential Evolution for Higher-Dimensional Multimodal Multiobjective Optimization. Journal of Automatica Sinica, 2024, 11, 1458-1475.

[6] Ye J.G., Xu S.S., Huang H.F., et al. Optimization Design of Nozzle Structure Inside Boiler Based on Orthogonal Design. Processes, 2023, 11, 2923.

[7] Tinós, R., Yang, S. Use of the q-Gaussian mutation in evolutionary algorithms. Soft computing, 2011, 15, 1523-1549.

[8] Shimo, H.K., Tinos, R. Use of self-organizing suppression and q-Gaussian mutation in artificial immune systems. Int. J. Intell. Comput. Cybern., 2013, 6, 296-322.

[9] Bartz-Beielstein, T. Experimental Research in Evolutionary Computation: The New Experimental-ism (Natural Computing Series). Springer-Verlag: Berlin, Germany, 2006.

[10] Sun, S., Xiong, G., Suganthan, P. N. Orthogonal Experimental Design Based Binary Optimization Without Iteration for Fault Section Diagnosis of Power Systems. IEEE Transactions on Industrial Informatics, 2024, 20, 2611-2619.

[11] Zeng, S. Y., Kang, L.S., Ding, L.X. An Orthogonal Multi-objective Evolutionary Algorithm for Multi-objective Optimization Problems with Constraints. Evol. Comput., 2004, 12, 77-98.

[12] Panda, A. Orthogonal array design based multi-objective CBO and SOS algorithms for band reduction in hyperspectral image analysis. Multimedia Tools Appl., 2023, 82, 35301–35327.

[13] Zitzler, E., Kuenzli, S. Indicator-based selection in multiobjective search. In 8th International Conference on Parallel Problem Solving from Nature (PPSN VIII), pp.832-842, Birmingham, UK, 18-22 Sept. 2004.

[14] Basseur, M., Burke, E. K. Indicator-based multiobjective local search. In Proceedings of the 2007 IEEE Congress on Evolutionary Computation (CEC2007), pp. 3100-3107, Singapore, 25-28 Sept 2007.

[15] Yi, W., Chen, Y., Pei, Z., et al. Adaptive differential evolution with ensembling operators for con-tinuous optimization problems. Swarm Evol. Comput., 2022, 69, 100994.

[16] Nakamura, R., Tadokoro, R., Yamagata, E. Pseudo-Outlier Synthesis Using Q-Gaussian Distribu-tions for Out-of-Distribution Detection. In Proceedings of the 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3120-3124, Seoul, Korea, 14-19 April 2024.

[17] Tsallis, C. Possible generalization of boltzmann-gibbs statistics. J. of Stat. Phys., 1988, 52, 479–487.

[18] Knowles, J. D. Local-Search and Hybrid Evolutionary Algorithm for Pareto Optimization. Ph.D., University of Reading, Berkshire, USA, 2002.

[19] Khare, V., Yao, X., Deb, K. Performance Scaling of Multi-objective Evolutionary Algorithms. In Proceedings of the 2003 Evolutionary Multi-Criterion Optimization(EMO2003), pp. 376-390, Faro, Portugal, 8-11 April 2003.

[20] Corne D.W., Jerram N.R., Knowles J.D., et al. PESA-II: Region-based selection in evolutionary multiobjective optimization. In Proceedings of the 3rd Annual Conference on Genetic and Evolu-tionary Computation, pp. 283-290, San Francisco, USA, 7-11 July 2001.

[21] Das, S., Suganthan, P. N. Differential Evolution: A Survey of the State-of-the-Art. IEEE Trans.Evol. Comput., 2011, 15, 4-31.

[22] Ishibuchi, H., Murata, T. A multi-objective genetic local search algorithm and its application to flowshop scheduling. IEEE Trans. Syst., Man, Cybern. C, 1998, 28, 392-403.

[23] Sindhya, K., Sinha, A., Deb, K., et al. (2009) Local Search Based Evolutionary Multi-objective Optimization Algorithm for Constrained and Unconstrained Problems. In Proceedings of the 2009 IEEE Congress on Evolutionary Computation (CEC2009), pp. 2919-2926, Trondheim, Norway, 18-21 May 2009.

[24] Chen, G., Jiao, J., Xue, X., et al. Rank-Based Learning and Local Model Based Evolutionary Al-gorithm for High-Dimensional Expensive Multi-Objective Problems. ArXiv, abs/2304.09444, 2023.

[25] Li, F., Gao, L., Shen, W. Surrogate-Assisted Multi-Objective Evolutionary Optimization With Pa-reto Front Model-Based Local Search Method. IEEE T CYBERNETICS., 2024, 54, 173-186.

[26] Zitzler, E. Evolutionary algorithms for multi-objective optimization: Methods and applications. Ph.D., ETH Zurich, Zurich, Switzerland, 1999.

[27] Van Veldhuizen, D.A. Multiobjective Evolutionary Algorithms: Classifications, Analyses, and New Innovations. Ph.D., Air Force Institute of Technology, Wright-Patterson AFB, Ohio, USA, 1999.

[28] Deb, K., Pratap, A., Agarwal, S., et al. A fast and elitist multiobjective genetic algorithm: NSGAII. IEEE Trans.Evol. Comput., 2002, 6, 182-197.

[29] Schott, J.R. Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimiza-tion, Master, Massachusetts Institute of Technology, Cambridge, Massachusetts, UK, 1995.

[30] Knowles, J.D., Thiele, L., Zitzler, E. A tutorial on the performance assessment of stochastive mul-tiobjective optimizers, TIK-Report No. 214, Computer Engineering and Networks Laboratory, ETH Zurich, Switzerland, 2006.

[31] Wang, L., Zhang, L., Ren, Y. Two comprehensive performance metrics for overcoming the defi-ciencies of IGD and HV. In Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp.197-198, online, 10-14 July 2021. 

[32] Zitzler, E., Thiele, L. Multiobjective Optimization Using Evolutionary Algorithms—A Compara-tive Study. In Proceedings of the 5th International Conference on Parallel Problem Solving from Na-ture, pp. 292-301, Amsterdam, Netherlands, 27-30 Sept. 1998.

[33] Coello Coello, C.A., Van Veldhuizen, D.A., Lamont, G.B. Evolutionary Algorithms for Solving Multi-Objective Problems. Kluwer Academic Publishers: New York, USA, 2002.

[34] Zitzler, E. Hypervolume metric calculation. ftp://ftp.tik.ee.ethz.ch/pub/people/zitzler/Hypervol.c, 2001.