The Impact of AI-powered Character AI on EFL Learners' Speaking: The Moderating Role of Anxiety

Document Type : Research Paper

Author

Allameh Mohaddes Nouri University; PhD Holder of TEFL from the University of Tehran, Iran

Abstract

Although several studies have examined the effectiveness of Artificial Intelligence (AI) tools in enhancing L2 speaking, it remains unclear whether learners with low and high levels of anxiety benefit similarly from AI-based instruction. The present study examined the extent to which learners with varying levels of anxiety, specifically high and low, benefit from an AI-based speaking assistant, Character AI. This research involved 30 intermediate EFL learners from a language institute, who were identified and labeled as high-anxiety (HA) and low-anxiety (LA) groups based on their anxiety scores. Following a sequential explanatory mixed-methods design, the initial phase involved administering the Oxford Placement Test (OPT) to determine participants' language proficiency, followed by a pre-test that served as a benchmark of their speaking proficiency before exposure to the Character AI app. Over the course of the study, participants engaged with Character AI for speaking practice and feedback. The results showed that Character AI-based support was beneficial for promoting FL speaking by fostering enhanced interaction and oral communication. It was also observed that learners with lower initial anxiety levels demonstrated greater improvements in speaking, implying that anxiety may moderate the benefits of AI-driven educational technologies. The qualitative findings underscore the potential of AI technologies as robust tools in L2 speaking, facilitating personalized, interactive, and learner-centric learning experiences. The present outcomes provide substantial insights into the interactions between psychological factors, technological integration, and language acquisition within the English as a Foreign Language (EFL) framework.

Keywords

Main Subjects


Alizadeh, M., Mehrpour, S., & Ghaemi, H. (2020). AI-driven pronunciation feedback vs. human teacher feedback: A comparative study. ReCALL, 32(4), 423-439. https://doi.org/10.1017/S0958344020000123
Almaiah, M. A., Alfaisal, R., Salloum, S. A., Hajjej, F., Thabit, S., El-Qirem, F. A., Lutfi, A., Alrawad, M., Al Mulhem, A., Alkhdour, T., Awad, A. B., & Al-Maroof, R. S. (2022). Examining the impact of artificial intelligence and social and computer anxiety in E-learning settings: Students' perceptions at the university level. Electronics, 11(22), 3662. http://doi.org/10.3390/electronics11223662
Alrishan, A. M. H. (2023). Determinants of intention to use ChatGPT for professional development among Omani EFL pre-service teachers. International Journal of Learning, Teaching and Educational Research22(12), 187-209. https://doi.org/10.26803/ijlter.22.12.10
Awan, R., Anwar, M., & Naz, A. (2010). An investigation of foreign language classroom anxiety and its relationship with students' achievement. Journal of College Teaching & Learning, 7(11), 33-40. https://doi.org/10.19030/tlc.v7i11.249  
Azizimajd, H. (2023). Investigating the impacts of voice-based student-chatbot interactions in the classroom on EFL learners' oral fluency and foreign language speaking anxiety. Technology Assisted Language Education1(2), 61-83. https://doi.org/10.22126/tale.2023.2732 
Bai, S. (2023). The predictive effects of foreign language anxiety and boredom on willingness to communicate among Chinese struggling EFL learners. Heliyon, 9(9), 1-11. https://doi.org/10.1016/j.heliyon.2023.e19610
Bashori, M., van Hout, R., Strik, H., & Cucchiarini, C. (2022). Web-based language learning and speaking anxiety. Computer Assisted Language Learning35(5-6), 1058-1089. https://doi.org/10.1080/09588221.2020.1770293
Bozorgian, H., & Shamsi, E. (2020). Computer-assisted pronunciation training on Iranian EFL learners' use of suprasegmental features: A case study. Computer-Assisted Language Learning Electronic Journal21(1), 93-113. https://doi.org/10.29140/callej.v21n1.299
Burston, J. (2014). MALL: The pedagogical challenges. Computer Assisted Language Learning, 27(4), 344-357. https://doi.org/10.1080/09588221.2014.914539
Çakmak, F. (2022). Chatbot-human interaction and its effects on EFL students' L2 speaking performance and anxiety. Novitas-ROYAL (Research on Youth and Language)16(2), 113-131. https://doi.org/10.24193/novitas-royal.16.2.07
Dakakni, D., & Safa, N. (2023). Artificial intelligence in the L2 classroom: Implications and challenges on ethics and equity in higher education: A 21st-century Pandora's box. Computers and Education: Artificial Intelligence5, 100179. https://doi.org/10.1016/j.caeai.2023.100179
Dizon, G. (2020). Evaluating the effectiveness of AI-driven chatbots in language learning. International Journal of Artificial Intelligence in Education, 30(3), 351-367. https://doi.org/10.1007/s40593-019-00190-3
Dörnyei, Z., & Ryan, S. (2015). The psychology of the language learner revisited. Routledge, 201-203.
El Shazly, R. (2020). Effects of artificial intelligence on English speaking anxiety and speaking performance: A case study. Expert Systems, 38(3), 1-15. https://doi.org/10.1111/exsy.12667  
Foote, J., Trofimovich, P., Collins, L., & Urzúa, E. (2012). Pronunciation teaching practices in communicative second language classrooms. The Language Learning Journal, 44(2), 181-196. https://doi.org/10.1080/09571736.2013.784345
Foroughi, B., Senali, M. G., Iranmanesh, M., Khanfar, A., Ghobakhloo, M., Annamalai, N., & Naghmeh-Abbaspour, B. (2024). Determinants of intention to use ChatGPT for educational purposes: Findings from PLS-SEM and fsQCA. International Journal of Human–Computer Interaction40(17), 4501-4520. https://doi.org/10.1080/10447318.2023.2226495
Gholamrezapour, E., & Salandari Rabori, M. A. (2019). Empathy as a predictor of pronunciation mastery: The case of female Iranian EFL learners' pronunciation errors. Journal of Teaching Language Skills, 38(2), 107-129.  https://doi.org/10.22099/jtls.2020.35609.2756   
Gilakjani, A. P. (2012). A study of factors affecting EFL learners' English pronunciation learning and the strategies for instruction. International Journal of Humanities and Social Science2(3), 119-128.
Given, L. M. (Ed.). (2008). The Sage encyclopedia of qualitative research methods (Vol 1 & 2). SAGE Publications. https://doi.org/10.4135/9781412961288.n133
Hedayati, H., & Marandi, S. (2014). Iranian EFL teachers' perceptions of the difficulties of implementing CALL. ReCALL, 26(3), 298-314. https://doi.org/10.1017/S0958344014000172 
Horwitz, E. K. (2010). Foreign and second language anxiety. Language Teaching, 43(2), 154-167. https://doi.org/10.1017/S026144480999036X
Horwitz, E., Horwitz, M., & Cope, J. (1986). Foreign language classroom anxiety. The Modern Language Journal, 70(2), 125-132. https://doi.org/10.1111/j.1540-4781.1986.tb05256.x
Hsu, T. C., Chang, C., & Jen, T. H. (2023). Artificial intelligence image recognition using self-regulation learning strategies: effects on vocabulary acquisition, learning anxiety, and learning behaviours of English language learners. Interactive Learning Environment, 32, 1–19. https://doi.org/10.1080/10494820.2023.2165508
Huang, Y., Lin, W., & Yu, Y. (2020). The effects of a mobile-assisted language learning (MALL) app on EFL learners' English pronunciation. ReCALL, 32(1), 1-20. https://doi.org/10.1017/S0958344019000196
Jeon, J. (2022). Exploring AI chatbot affordances in the EFL classroom: Young learners' experiences and perspectives. Computer Assisted Language Learning, 37(3), 1-26. http://doi.org/10.1080/09588221.2021.2021241
Jeon, J., & Lee, S. (2024). Can learners benefit from chatbots instead of humans? A systematic review of human-chatbot comparison research in language education. Education and Information Technologies, 1-32. https://doi.org/10.1007/s10639-023-11635-0
Kang, H. (2022). Effects of artificial intelligence and native speaker interlocutors on ESL learners' speaking ability and affective aspects. Multimedia-Assisted Language Learning, 25, 9–43. http://doi.org/10.15702/mall.2022.25.2.09
Kaur, R., Singh, A., & Kaur, J. (2022). The effect of AI-based language learning tools on foreign language anxiety. Journal of Language and Education, 8(2), 195-210. https://doi.org/10.17323/jle.2022.2.12  
Klimova, B., & Chen, J. H. (2024). The impact of AI on enhancing students' intercultural communication competence at the university level: A review study. Language Teaching Research Quarterly, 43, 102-120. https://doi.org/10.32038/ltrq.2024.43.06
Lee, D., Kim, H., & Sung, S. (2022). Development research on an AI English learning support system to facilitate learner-generated context-based learning. Educational Technology Research and Development, 71(2), 629-666. https://doi.org/10.1007/s11423-022-10172-2
Liu, B., & Yuan, D. (2024). Research on personalized teaching strategies based on learner profiles in a blended learning environment. International Journal of Information and Communication Technology Education (IJICTE)20(1), 1-23. https://doi.org/10.4018/IJICTE.346823
MacIntyre, P. D. (2017). An overview of language anxiety research and trends in its development. In C. Gkonou, M. Daubney, & J.-M. Dewaele (Eds.), New insights into language anxiety: Theory, research and educational implications. Multilingual Matters, 11–30. https://doi.org/10.21832/9781783097722-003
MacIntyre, P. D., & Gardner, R. C. (1994). The subtle effects of language anxiety on cognitive processing in the second language. Language Learning, 44(2), 283-305. https://doi.org/10.1111/j.1467-1770.1994.tb01103.x
Marcos-Llinás, M., & Garau, M. (2009). Effects of language anxiety on three proficiency-level courses of Spanish as a foreign language. Foreign Language Annals, 42(1), 94-111. https://doi.org/10.1111/j.1944-9720.2009.01010.x
Mehrpour, S., Shoushtari, S. A., & Shirazi, P. H. N. (2016). Computer-assisted pronunciation training: The effect of integrating accent reduction software on Iranian EFL learners' pronunciation. Computer-Assisted Language Learning Electronic Journal17(1), 97-112.
Nasri, M., Shafiee, S., & Sepehri, M. (2022). An account of Iranian EFL learners' speaking complexity, accuracy, and fluency and foreign language speaking anxiety in a computer-assisted language learning environment. Computer-Assisted Language Learning Electronic Journal23(2), 299-321. https://doi.org/10.19173/callej.23.2.408
Ngo, T. T.-N., Chen, H. H.-J. & Lai, K. K.-W. (2024). The effectiveness of automatic speech recognition in ESL/EFL pronunciation: A meta-analysis. ReCALL, 36(1),  4–21. https://doi.org/10.1017/S0958344023000113
Nguyen, T. T. H. (2023). EFL teachers' perspectives toward the use of ChatGPT in writing classes: A case study at Van Lang University. International Journal of Language Instruction, 2(3), 1–47. https://doi.org/10.54855/ijli.23231
Nushi, M., Jafari, R., & Golesorkhi, Z. (2019). Iranian EFL learners' beliefs towards teaching and learning of pronunciation. Journal of English Language Teaching and Learning11(23), 221-251.
Labadze, L., Grigolia, M., & Machaidze, L. (2023). Role of AI chatbots in education: systematic literature review. International Journal of Educational Technology in Higher Education, 20(56), 1-17. https://doi.org/10.1186/s41239-023-00426-1
Öztürk, G., & Gürbüz, N. (2014). Speaking anxiety among Turkish EFL learners: The case at a state university. Journal of Language and Linguistic Studies10(1), 1-17.
Peña-Acuña, B., & Corga Fernandes Durão, R. (2024). Learning English as a second language with artificial intelligence for prospective teachers: a systematic review. Frontiers in Education,  9, 1-7.
Pennington, M. C. (1999). Computer-aided pronunciation pedagogy: Promise, limitations, directions. Computer Assisted Language Learning12(5), 427-440. https://doi.org/10.1177/0033688220977406
Pérez, J. Q., Daradoumis, T., & Puig, J. M. M. (2020). Rediscovering the use of chatbots in education: A systematic literature review. Computer Applications in Engineering Education28(6), 1549-1565. https://doi.org/10.1002/cae.22326
Qiao, H., & Zhao, A. (2023). Artificial intelligence-based language learning: illuminating the impact on speaking skills and self-regulation in Chinese EFL context. Frontiers in Psychology, 14, 1-15.
Rezai, A., Namaziandost, E., & Hwang, G. J. (2024). How can ChatGPT open promising avenues for L2 development? A phenomenological study involving EFL university students in Iran. Computers in Human Behavior Reports16, 1-17. https://doi.org/10.1016/j.chbr.2024.100510
Saddiqa, D. A., Masood, D. S., Amjad, D. I., & Asif, A. (2024). Second language anxiety: Examining its role as a barrier or facilitator in second language acquisition. Internatonal Journal of Contemporary Issues in Social Sciences, 3(2), 378-388. Retrieved from https://ijciss.org/index.php/ijciss/article/view/646
Sarwari, A. Q., Javed, M. N., Adnan, H. M., & Wahab, M. N. A. (2024). Assessment of the impacts of artificial intelligence (AI) on intercultural communication among postgraduate students in a multicultural university environment. Scientific Reports, 14, 13849. https://doi.org/10.1038/s41598-024-63276-5
Sayfutdinovna Abdullaeva, B., Abdullaev, D., & Djuraeva, L. (2024). Decoding the significance of digital literacies among EFL learners: A probe into the consequences on technostress, foreign language anxiety, academic enjoyment, and language achievement. Applied Research on English Language13(4), 101-128. https://doi.org/10.22108/are.2024.141205.2274
Schunk, D. H., & Zimmerman, B. (2008). Motivation and self-regulated learning: Theory, research, and applications. Routledge.
Scovel, T. (1978). The effect of affect on foreign language learning: A review of the anxiety research. Language Learning, 28(1), 129-142. https://doi.org/10.1111/j.1467-1770.1978.tb00309.x
Shabani, K., & Jabbari, A. (2023). Differential effects of interaction-embedded vs interaction-reduced modes of fully online flipped instruction on EFL learners' speaking. Computer Assisted Language Learning, 1-27. doi.org/10.1080/09588221.2023.2219280 
Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14, 1260843. https://doi.org/10.3389/fpsyg.2023.1260843
Stolvoort, J., Mackaaij, M., & Tribushinina, E. (2024). Age of onset, motivation, and anxiety as predictors of grammar and vocabulary outcomes in English as a foreign language learners with developmental language disorder. Journal of Communication Disorders, 108, 106407. https://doi.org/10.1016/j.jcomdis.2024.106407
Teimouri, Y., Goetze, J., & Plonsky, L. (2019). Second language anxiety and achievement: A meta-analysis. Studies in Second Language Acquisition, 41(2), 363-387. https://doi.org/10.1017/S0272263118000311
Tzu-Yu, T., & Chen, H. (2022). The impact of intelligent personal assistants on adolescent EFL learners' speaking proficiency. Computer Assisted Language Learning, 37, 1-28. https://doi:10.1080/09588221.2022.2070219
Vančová, H. (2023). AI and AI-powered tools for pronunciation training. Journal of Language and Cultural Education, 11(3). https://doi.org/10.2478/jolace-2023-0022
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Cambridge, MA: Harvard University Press.
Wang, Y., Wei, C., Lin, H., Wang, S., & Wang, Y. (2022). What drives students' AI learning behavior: A perspective of AI anxiety. Interactive Learning Environments, 1-17. http://doi.org/10.1080/10494820.2022.2153147
Wei, L. (2023). Artificial intelligence in language instruction: impact on English learning achievement, L2 motivation, and self-regulated learning. Frontiers in Psychology, 14, 1261955. https://doi.org/10.3389/fpsyg.2023.1261955
Wen, F., Li, Y., Zhou, Y., An, X., & Zou, Q. (2024). A study on the relationship between AI anxiety and AI behavioral intention of secondary school students learning English as a foreign language. Journal of Educational Technology Development and Exchange (JETDE)17(1), 130-154. https://doi.org/10.18785/jetde.1701.07
Xin, Z., & Derakhshan, A. (2024). From excitement to anxiety: Exploring English as a foreign language learners' emotional experiences in the artificial intelligence‐powered classrooms. European Journal of Education, 60(1), e12845. https://doi.org/10.1111/ejed.12845
Young, D. J. (1991). Creating a low-anxiety classroom environment: What does language anxiety research suggest? The Modern Language Journal, 75(4), 426-439. https://doi.org/10.1111/j.1540-4781.1991.tb05378.x
Yu, C., & Yao, G. (2024). Enhancing student engagement with AI-driven personalized learning systems. International Transactions on Education Technology (ITEE), 3(1), 1-8. https://doi.org/10.33050/itee.v3i1.662
Zhang, S., Shan, C., Lee, J. S. Y., Che, S., & Kim, J. H. (2023). Effect of chatbot-assisted language learning: A meta-analysis. Education and Information Technologies28(11), 15223-15243. https://doi.org/10.1007/s10639-023-11805-6
Zou, B., Guan, X., Shao, Y., & Chen, P. (2023). Supporting speaking practice by social network-based interaction in artificial intelligence (AI)-assisted language learning. Sustainability, 15, 2872. https://doi.org/10.3390/su15042872