In recent years, with the vigorous development of artificial intelligence technology, an increasing number of researchers and frontline teachers have applied it to foreign language education scenarios. At present, a small number of studies have explored the impact of integrating AI into EFL teaching on learners’ listening ability through quasi-experimental designs. However, these studies only reported whether there were significant differences in listening scores between the experimental class and the control class, without reporting the effect size. Thus, the extent to which the integration of AI technology affects listening proficiency remains unknown. In view of this, this study conducted a meta-analysis of 15 quasi-experimental studies. The fixed-effects model showed that the adjusted combined effect size was 0.42, which reached a statistically significant level, indicating that the integration of AI has a moderate positive impact on EFL listening teaching. This article also discusses the implications of the research results for teaching.

Feng Yue. Does Integrating Artificial Intelligence into EFL Instruction Improve Learners' Listening Proficiency? Evidence from a Meta-analysis of Quasi-experimental Studies. Academic Journal of Humanities & Social Sciences (2026), Vol. 9, Issue 1: 36-43. https://doi.org/10.25236/AJHSS.2026.090106.

[1] Wang Z, Chen Z, Li L, et al. Between support and substitution: the impact of artificial intelligence use on anxiety and learning performance among Spanish majors in China[J]. Frontiers in Psychology, 2025, 16: 1710445.

[2] Khan M O, Khan S. Influence of online versus traditional learning on EFL listening skills: A blended mode classroom perspective[J]. Heliyon, 2024, 10(7): e28510.

[3] Ma Y, Tang X J, Huang X. AI-powered adaptive English language learning systems: Leveraging deep learning algorithms and natural language processing for personalized teaching approaches[J]. IEEE Access, 2025, 13: 153189-153198.

[4] Zhang Z. Enhancing English listening comprehension via AI-based adaptive learning platforms incorporating speech-to-text and predictive analytics[J]. Systems and Soft Computing, 2025, 7: 200418.

[5] Abdelsalam H E, Mahmoud N M. Using an artificial intelligence based program to enhance primary stage pupils’ EFL listening skills[J]. Sohag Universit Journal of Education, 2021, 83: 1-32. 

[6] Ali Y A, Naeem S, Alqarni S, et al. Evaluating the impact of artificial intelligence-based tools on listening comprehension among ESL learners[J]. Contemporary Journal of Social Science Review, 2025, 3(3): 514-522.

[7] Koç F Ş. The development of listening and speaking skills in EFL via an artificially intelligent chatbot application: A quasi-experimental design study[D]. Middle East Technical University (Turkey), 2024.

[8] Izadi M, Izadi M, Heidari F. The potential of an adaptive computerized dynamic assessment tutor in diagnosing and assessing learners’ listening comprehension[J]. Education and Information Technologies, 2024, 29(3): 3637-3661.

[9] Baylari A, Montazer G A. Design a personalized e-learning system based on item response theory and artificial neural network approach[J]. Expert Systems with Applications, 2009, 36(4): 8013-8021.

[10] Meng N, Mat Deli M, Abdul Rauf U A. Educational Technology and AI: Bridging Cognitive Load and Learner Engagement for Effective Learning[J]. Sage Open, 2025, 15(4): 21582440251395930.

[11] Huang M, Mahmud M M, Shuang G C. Impact of real time feedback features on listening accuracy of Chinese university English learners via iSmart teaching platforms[J]. Journal of Advanced Research in Social and Behavioural Sciences, 2025, 40(1): 163-177.

[12] Mohebbi A. Enabling learner independence and self-regulation in language education using AI tools: a systematic review[J]. Cogent Education, 2025, 12(1): 2433814.

[13] Yeldham M, Gao Y J. Examining whether learning outcomes are enhanced when L2 learners’ cognitive styles match listening instruction methods[J]. System, 2021, 97: 102435.

[14] Sun W. The impact of automatic speech recognition technology on second language pronunciation and speaking skills of EFL learners: a mixed methods investigation[J]. Frontiers in psychology, 2023, 14: 1210187.

[15] Xiao Y. The impact of AI-driven speech recognition on EFL listening comprehension, flow experience, and anxiety: a randomized controlled trial[J]. Humanities and Social Sciences Communications, 2025, 12(1): 1-14.

[16] Bui H T, Filimonau V, Sezerel H. AI-thenticity: Exploring the effect of perceived authenticity of AI-generated visual content on tourist patronage intentions[J]. Journal of Destination Marketing & Management, 2024, 34: 100956.

[17] Kenny D A. A quasi-experimental approach to assessing treatment effects in the nonequivalent control group design[J]. Psychological Bulletin, 1975, 82(3): 345-362.

[18] Zuckerman I H, Lee E, Wutoh A K, et al. Application of regression‐discontinuity analysis in pharmaceutical health services research[J]. Health Services Research, 2006, 41(2): 550-563.

[19] Alrasheedi S. The Effect of Using AI Applications to Develop EFL Listening Comprehension Skills among University Students[J]. Conhecimento & Diversidade, 2024, 16(44): 601-637.

[20] Ghareeb Ahmed Ali S. Using an artificial intelligence application for developing primary school pupils’ oral language skills[J]. Sohag University Journal of Education ,2020, 75(75): 67-110.‎

[21] Kim N Y. AI-integrated mobile-assisted language learning: Is it an effective way of preparing for the TOEIC test in classroom environments?[J]. English Teaching, 2022, 77(3): 79-102.

[22] Sahito J K M, Panwar A H, Ramzan I. Exploreing the impact of AI on the listening skills of ESL learners[J]. Journal of Applied Linguistics and TESOL (JALT), 2025, 8(1): 1059-1067.

[23] Lv Z, Zhang L. Investigating the effectiveness of artificial intelligence in English listening teaching: A case study of the New Concept English AI[J]. International Journal of Web-Based Learning and Teaching Technologies, 2025, 20(1): 1-19.

[24] Abdellatif M S, Alshehri M A, Alshehri H A, et al. I am all ears: listening exams with AI and its traces on foreign language learners’ mindsets, self-competence, resilience, and listening improvement [J]. Language Testing in Asia, 2024, 14(1): 54.

[25] Zhou Q, Hashim H, Sulaiman N A. Integrating AI chatbots in informal digital English learning: impacts on listening competencies in Chinese higher education[J]. Education and Information Technologies, 2025: 1-29.

[26] Wu S, Wang F. Artificial intelligence-based simulation research on the flipped classroom mode of listening and speaking teaching for English majors[J]. Mobile Information Systems, 2021, 2021(1): 4344244.

[27] Jesinth F J. Effects on developing listening skill for ELF student’s with artificial intelligence[J]. Journal of Information Systems Engineering & Management, 2025, 10(48s):1221-1229.

[28] Dorgham R. Using artificial intelligence tools for developing EFL students’ listening skills and reducing their listening anxiety[J]. Educational and Psychological Studies, 2025, 40: 513-577.

[29] Jiang L, Wei M, Zhai Y. An empirical study of AIGC enabled high school English listening class in China[J]. Journal of Education, Humanity and Arts Research, 2025, 1(1): 1-5.

[30] Loebis I A. Effectiveness of AI-based English language learning apps in improving listening skills[J]. Lingeduca: Journal of Language and Education Studies, 2025, 4(1): 9-16.

[31] Cohen J. Statistical power analysis for the behavioral sciences[M]. New York: Academic Press, 2015.

[32] Borenstein M, Hedges L V, Higgins J P T, et al. Introduction to meta-analysis[M]. John Wiley & Sons, 2021.

[33] Lo A W T. The educational affordances and challenges of generative AI in Global Englishes-oriented materials development and implementation: A critical ecological perspective[J]. System, 2025, 130: 103610.

[34] Biswas U, Bhattacharya S. ML-based intelligent real-time feedback system for blended classroom [J]. Education and Information Technologies, 2024, 29(4): 3923-3951.

[35] Qiu J. Voice and Beyond: Shaping the Future of Personalized Conversational Agents[D]. OCAD University, 2025.