International Journal of New Developments in Education, 2026, 8(8); doi: 10.25236/IJNDE.2026.080806.
Huizhuo Zhang, Haibin Qiu, Jie Wang
Shenyang Open University, Shenyang, China
Addressing the shortcomings of current English teaching courseware in terms of static and personalized adaptation, and the fact that computer vision technology in education primarily focuses on classroom monitoring and lacks direct linkage with courseware design, this paper proposes a multimodal interactive perception-based dynamic adaptation algorithm for English courseware content. This algorithm collects text and image features from the courseware using an EAST-L network and a lightweight Mask R-CNN, and combines optimized Media Pipe Hands and an emotion classification model to obtain learner gesture and emotion data. Through dynamic interval normalization and an attention mechanism, multimodal features are fused to construct a capability-state association model, and real-time adaptation of courseware content is achieved based on an adjustment intensity formula. The experiment used 300 English courseware materials from primary and secondary schools as the resource set and conducted an 8-week test on 200 learners aged 10-15. The results showed that the accuracy rate of courseware content adaptation reached 92.3%, an improvement of 37.6% compared to traditional static courseware; the average interactive response latency was 72ms (≤85ms); the average score of the experimental group was 89.2 points, an improvement of 18.7% compared to the control group, and the attention maintenance rate increased by 29.4%. The research indicates that this algorithm can effectively improve the personalization and interactivity of courseware, providing a new path for visual technology-assisted educational resource design.
Computer vision; English teaching courseware; multimodal interactive perception; dynamic adaptation algorithm; gesture command detection
Huizhuo Zhang, Haibin Qiu, Jie Wang. Research on Algorithm Research for English Teaching Courseware Design Assisted by Computer Vision Technology. International Journal of New Developments in Education (2026), Vol. 8, Issue 8: 44-52. https://doi.org/10.25236/IJNDE.2026.080806.
[1] Xia Lixin, Yang Zongkai, Huang Ronghuai, & Gu Jianjun. Digitalization of Education and Educational Reform in the New Era (Notes). Journal of Central China Normal University (Humanities and Social Sciences Edition), vol. 62, pp. 1-22, May 2023.
[2] Chen Zengzhao, Shi Yawen, & Wang Mengke. The Real-world Landscape of Artificial Intelligence Promoting Educational Reform—An Analysis of Teachers' Coping Strategies with ChatGPT. Journal of Guangxi Normal University (Philosophy and Social Sciences Edition), vol. 59, pp. 75-85, February 2023.
[3] Cheng Zhang, Jianfeng Li, Rong Zhang, Yiwen Tang, & Zaoran Mou. A Study on the Dynamic Training Mechanism of Dual-Qualified Teachers in Universities Guided by "Dual Ability and Dual Efficiency". Journal of Modern Chinese Education, vol. 1, pp. 80-98, February 2025.
[4] Umar Ibrahim, A., Al-Turjman, F., Ozsoz, M., & Serte, S. Computer Aided Detection of Tuberculosis Using Two Classifiers. Biomedical Engineering/Biomedizinische Technik, vol. 67, pp. 513-524, June 2022.
[5] Chen, Tzu-An, & Huang, Po-Sheng. The Effect of Micro-Courses on Attention and Learning Retention. Journal of Educational Psychology, vol. 52, pp. 885-907, April 2021.
[6] Li, H. Improved Fuzzy-Assisted Hierarchical Neural Network System for Design of Computer-Aided English Teaching System. Computational Intelligence, vol. 37, pp. 1199-1216, March 2021.
[7] Shivegowda, M. D., Boonyasopon, P., Rangappa, S. M., & Siengchin, S. A Review on Computer-Aided Design and Manufacturing Processes in Design and Architecture. Archives of Computational Methods in Engineering, vol. 29, pp. 3973-3980, June 2022.
[8] Wataya, T., Yanagawa, M., Tsubamoto, M., Sato, T., Nishigaki, D., Kita, K., ... & Osaka University Reading Team. Radiologists with and Without Deep Learning–Based Computer-Aided Diagnosis: Comparison of Performance and Interobserver Agreement for Characterizing and Diagnosing Pulmonary Nodules/Masses. European Radiology, vol. 33, pp. 348-359, January 2023.
[9] Feng, F., Na, W., Jin, J., Zhang, J., Zhang, W., & Zhang, Q. J. Artificial Neural Networks for Microwave Computer-Aided Design: The State of the Art. IEEE Transactions on Microwave Theory and Techniques, vol. 70, pp. 4597-4619, November 2022.
[10] Hassan, C., Spadaccini, M., Mori, Y., Foroutan, F., Facciorusso, A., Gkolfakis, P., ... & Repici, A. Real-Time Computer-Aided Detection of Colorectal Neoplasia During Colonoscopy: A Systematic Review and Meta-Analysis. Annals of Internal Medicine, vol. 176, pp. 1209-1220, September 2023.
[11] Li Wei, Wu Dongxuan, Liu Zhenzhen, & Zou Yuxian. Current Status and Reform of Eight-Year Medical Education. Acta Ophthalmologica Sinica, vol. 37, pp. 76-82, January 2022.
[12] Wang Haijun. Exploration and Application Prospect of Large-Scale Model Construction Path in the Mining Industry. Coal Science and Technology, vol. 52, pp. 45-59, November 2024.
[13] Khanna, M., Singh, L. K., Thawkar, S., & Goyal, M. Deep Learning Based Computer-Aided Automatic Prediction and Grading System for Diabetic Retinopathy. Multimedia Tools and Applications, vol. 82, pp. 39255-39302, September 2023.