ChatGPT, a large-scale language model, holds significant potential for providing consistent and timely feedback, thereby offering comprehensive support across various dimensions of writing. However, existing research is limited in its exploration of the specific impact of ChatGPT's written feedback on English as a Foreign Language (EFL) learners with low language proficiency. This study delves into the effects of ChatGPT feedback on such learners, utilizing data from prompt-feedback interactions and subsequent interview analyses. The findings reveal that the essay reviewing process, involving interactions with ChatGPT in English, posed substantial challenges for the learners. Additionally, the study suggests that ChatGPT's written feedback has limitations in effectively enhancing the writing skills of learners in this proficiency category.

Yingxia Li, Wanyi Du, Bike Zhu. Cognitive Engagement of Low Proficiency Learners: Evaluating the Impact of ChatGPT Feedback in EFL Writing. Frontiers in Educational Research (2023) Vol. 6, Issue 28: 69-73. https://doi.org/10.25236/FER.2023.062809.

[1] Kahn, K., & Winters, N. (2021). Constructionism and AI: A history and possible futures. British Journal of Educational Technology, 52(3), 1130–1142. https://doi.org/ 10.1111/bjet.13088

[2] Hsieh, Y. Z., Lin, S. S., Luo, Y. C., Jeng, Y. L., Tan, S. W., Chen, C. R., & Chiang, P. Y. (2020). ARCS-assisted teaching robots based on anticipatory computing and emotional Big Data for improving sustainable learning efficiency and motivation. Sustainability (Switzerland), 12(14). https://doi.org/10.3390/su12145605.

[3] Yang, Y. Y., & Shulruf, B. (2019). Expert-led and artificial intelligence (AI) system- assisted tutoring course increase confidence of Chinese medical interns on suturing and ligature skills: Prospective pilot study. Journal of Educational Evaluation for Health Professions, 16. https://doi.org/10.3352/jeehp.2019.16.7

[4] Topal, A. D., Eren, C. D., & Gecer, A. K. (2021). Chatbot application in a 5th grade science course. Education and Information Technologies, 26(5), 6241–6265. https://doi.org/ 10.1007/s10639-021-10627-8

[5] Ma, H., & Slater, T. (2015). Using the developmental path of cause to bridge the gap between AWE scores and writing teachers’ evaluations. Writing & Pedagogy, 7(2–3), 395–422. https://doi.org/10.1558/wap.v7i2-3.26376

[6] Sun, Y. (2021). Application of artificial intelligence in the cultivation of art design professionals. International Journal of Emerging Technologies in Learning, 16(8), 221–237. https://doi.org/10.3991/ijet.v16i08.22131

[7] Chew, E., & Chua, X. N. (2020). Robotic Chinese language tutor: Personalising progress assessment and feedback or taking over your job? On the Horizon, 28(3), 113–124. https://doi.org/10.1108/OTH-04-2020-0015

[8] Dikli, S. (2010). The nature of automated essay scoring feedback. CALICO Journal, 28, 99–134.

[9] Weigle, S. C. (2013). English as a second language writing and automated essay evaluation. in M. D. Shermis & J. Burstein (Eds.), Handbook of automated essay evaluation: Current applications and new directions (pp. 36–54). new york, ny: Routledge.

[10] Dizon, G., & Gayed, J. M. (2021). Examining the Impact of Grammarly on the Quality of Mobile L2 Writing. JALT CALL Journal, 17(2), 74–92. https://doi.org/10.29140/jaltcall.v17n2.336

[11] Nazari, N., Shabbir, M. S., & Setiawan, R. (2021). Application of Artificial Intelligence powered digital writing assistant in higher education: Randomized controlled trial. Heliyon, 7(5), e07014. https:// doi.org/10.1016/j.heliyon.2021.e07014

[12] Guo, K., Wang, J., & Chu, S. K. W. (2022). Using chatbots to scaffold EFL students’ argumentative writ- ing. Assessing Writing, 54, 100666. https://doi.org/10.1016/j.asw.2022.100666

[13] Zhai, X. (2022). ChatGPT user experience: Implications for education. Available at SSRN4312418.

[14] Gilson, A., Safranek, C., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2022). How well does ChatGPT do when taking the medical licensing exams? The implications of large language models for medical education and knowledge assessment. medRxiv, 1–9. https://doi.org/10.1101/ 2022.12.23.22283901

[15] Qadir, J. (2022). Engineering education in the era of ChatGPT: Promise and pitfalls of generative AI for education. TechRxiv. Preprint. https://doi.org/10.36227/techrxiv.21789434.v1

[16] Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2022). Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers. BioRxiv, 2022-12.

[17] Guo, K., & Wang, D. (2023). To resist it or to embrace it? Examining ChatGPT’s potential to support teacher feedback in EFL writing. Education and Information Technologies, 1-29. https://doi.org/10.1007/s10639-023-12146-0