AI-mediated Interaction through an AI Voice Chatbot: Effects on EFL Speaking Development and Learner Perceptions
Authors
- Nguyen Nu Thuy Uyen University of Foreign Language Studies, The University of Danang
Abstract
This study investigated the effects of AI-mediated speaking practice using a voice chatbot on Vietnamese EFL students’ speaking skills and explored their perceptions of the learning experience. A sequential explanatory mixed-methods design was adopted with 49 English-major undergraduates participating in a 15-week quasi-experimental intervention. The experimental group practiced speaking with an AI chatbot, whereas the comparison group received face-to-face instruction. Data were collected from pre- and post-speaking tests, questionnaires and semi-structured interviews. ANCOVA indicated that, after controlling for pre-test performance, the AI chatbot group achieved significantly higher overall speaking scores than the comparison group, particularly in fluency and coherence. Additionally, participants valued the chatbot’s authentic interaction, flexibility, and opportunities for regular speaking practice despite reporting occasional technical and interactional limitations. The findings support the pedagogical value of AI-mediated speaking practice in higher education.
References
Adamopoulou, E., & Moussiades, L. (2020). Chatbots: History, technology, and applications. Machine Learning with Applications, 2, Article 100006.
Baek, J., & Lee, C. H. (2018). University students ’perceptions and engagement in mobiassisted blended learning in English speaking classes. Multimedia-Assisted Language Learning, 21(4). https://doi.org/10.15702/mall.2018.21.4.11
Brown, H. D., & Lee, H. (2015). Teaching by principles: An interactive approach to languagepedagogy (4th ed.). Pearson Education, Inc.
Bui, T. T. L.; Huynh, T. M. D.; Nguyen, T. M. N.; Nguyen, T. N. C.; & Nguyen, T. Y. N. (2022). The difficulties in oral presentation of English-majored juniors at Tay Do University. European Journal of English Language Teaching, 7(2), 170-215. https://doi.org/10.46827/ejel.v7i2.4238
Çakmak, F. (2022). Chatbot-human interaction and its effects on EFL students’ L2 speaking performance and anxiety. Novitas-ROYAL (Research on Youth and Language), 16(2), 113-131.
Chen, M. R. A., & Hwang, G. J. (2019). Effects of a concept mapping‐based flipped learning approach on EFL students’ English speaking performance, critical thinking awareness and speaking anxiety. British Journal of Educational Technology, 51(3), 817-834. https://doi.org/10.1111/bjet.12887
Chiu, T.-S., Liou, H.-C., & Yeh, Y. (2007). A study of web-based oral activities enhanced by automatic speech recognition for EFL college learning. Computer Assisted Language Learning, 20(3), 209–234. https://doi.org/10.1080/09588220701489374
Creswell, J. W., Plano Clark, V. L., Gutmann, M., & Hanson, W. (2003). Advanced mixed methods research designs. In A. Tashakkori, & C. Teddlie (Eds.), Handbook on mixed methods in the behavioral and social sciences (pp. 209–240). Sage Publications.
Dao, H. (2017). Identify factors that negatively influence: Non-English major students’ speaking skills. Higher Education Research, 2(2), 35-43.
Dizon, G. (2020). Evaluating intelligent personal assistants for L2 listening and speaking development. Language, Learning and Technology, 24(1), 16–26, 10125/44705.
Duong, Tam & Suppasetseree, Suksan. (2024). The Effects of an Artificial Intelligence Voice Chatbot on Improving Vietnamese Undergraduate Students’ English Speaking Skills. International Journal of Learning, Teaching and Educational Research, 23,293-321. https://doi.org/10.26803/ijlter.23.3.15.
El Shazly, R. (2021). Effects of artificial intelligence on English speaking anxiety and speaking performance: A case study. Expert Systems, 38(3), e12667. https://doi.org/10.1111/exsy.12667
Engeström, Y. (1987). Learning by expanding: An activity-theoretical approach to developmental research. Orienta-Konsultit.
Engwall, O., & B¨alter, O. (2007). Pronunciation feedback from real and virtual languageteachers. Computer Assisted Language Learning, 20(3), 235–262.
Du, J.; & Daniel, B. K. (2024). Transforming language education: A systematic review of AI-powered chatbots for English as a foreign language speaking practice. Computers and Education: Artificial Intelligence, 6. Article: 100230. https://doi.org/10.1016/j.caeai.2024.100230
Fathi, J., Rahimi, M; & Derakhshan, A. (2024). Improving EFL learners’ speaking skills and willingness to communicate via artificial intelligence-mediated interactions. System, 121, 103254, https://doi.org/10.1016/j.system.2024.103254
Fryer, L., & Carpenter, R. (2006). Emerging technologies: Bots as language learning tools. Language, Learning and Technology, 10(3), 8–14. Retrieved from http://llt. msu.edu/vol10num3/emerging/
Hakim, R., & Rima, R. (2022). Chatting with AI Chatbots applications to improve English communication skill. Journal of English Language Studies, 7(1), 121–130. https://doi.org/10.30870/jels.v7i1.14327
Haristiani, N. (2019). Artificial intelligence (AI) chatbot as language learning medium: An inquiry. International Conference on Education, Science and Technology, 1387(1), 012020. https://doi.org/10.1088/1742-6596/1387/1/012020
Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning - are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38(1), 237–257. https://doi.org/10.1111/jcal.12610
Hwang, W. Y., Guo, B. C., Hoang, A., Chang, C. C., & Wu, N. T. (2024). Facilitating authentic contextual EFL speaking and conversation with smart mechanisms and investigating its influence on learning achievements. Computer Assisted Language Learning, 37(7), 1632–1658. https://doi.org/10.1080/09588221.2022.2095406
Jeon, J. (2021). Chatbot-assisted dynamic assessment (CA-DA) for L2 vocabulary learning and diagnosis. Computer Assisted Language Learning, 36(7), 1338–1364. https://doi.org/10.1080/09588221.2021.1987272
Kim, N. Y. (2016). Effects of voice chat on EFL learners’ speaking ability according to proficiency levels. Multimedia Assisted Language Learning, 19(4), 63–88.
Kim, N.-Y, Cha, Y., & Kim, H. -S. (2019). Future English Learning: Chatbots and Artificial Intelligence. Multimedia-Assisted Language Learning, 22, 32-53.
Kim, H.-S., Cha, Y., & Kim, N. Y. (2021). Effects of AI voice chatbots on EFL students’ communication skills. Korean Journal of English Language and Linguistics, 21, 712734. https://doi.org/10.15738/kjell.21..202108.712
Li, Q., & Chan, K. K. (2024). Test takers’ attitudes of using exam-oriented mobile application as a tool to adapt in a high-stakes speaking test. Education and Information Technologies, 29(1), 219–237. https://doi.org/10.1007/s10639-023-12297-0
Lu, C. H., Chiou, G. F., Day, M. Y., Ong, C. S., & Hsu, W. L. (2006). Using instant messaging to provide an intelligent learning environment. In Proceedings of the international conference on intelligent tutoring systems (pp. 575–583). Springer. https://doi.org/10.1007/11774303_57.
Nguyen, T. A. (2025). Addressing English-speaking anxiety in Vietnamese initial teacher education: Beyond coping strategies. Asian-Pacific Journal of Second and Foreign Language Education, 10(1), 1-27. https://doi.org/10.1186/s40862-025-00324-1
Nguyen, T. H. (2026). The Impact of AI Chatbot Integration on Vietnamese EFL Learners’ Speaking Performance, Fluency, and Confidence. Lang. Technol. Soc. Media, 4, 1, 70–88. https://doi.org/10.70211/ltsm.3026-7196.314
Nguyen, T. T., & Tong, T. T. N. (2024). Investigation into Difficulties in Public Speaking among English-majored Students at University of Phan Thiet. International Journal of Language Instruction, 3(1), 17- 30. https://doi.org/10.54855/ijli.24312
Nguyen, B. D., & Trinh, N. A. (2025). The Causes of English Language Learning Anxiety among English Major Seniors at a Vietnamese University. International Journal of Language Instruction, 4(4), 66- 82. https://doi.org/10.54855/ijli.25445
Peng, J. (2019). The roles of multimodal pedagogic effects and classroom environment in willingness to communicate in English. System, 82, 161–173. https://doi.org/10.1016/j.system.2019.04.006
Pentina, I; Hancock, T; Xie, T. (2023). Exploring relationship development with social chatbots: A mixed-method study of Replika. Computers in Human Behavior, 140(2):107600. https://doi.org/10.1016/j.chb.2022.107600.
Quyen, V. P., Nga, P. T. M., & Nguyen, H. T. (2018). Challenges to speaking skills encountered by English-majored students: A story of one Vietnamese university in the Mekong Delta. Can Tho University Journal of Science, 54(5), 38-44. https://doi.org/10.22144/ctu.jen.2018.022
Schreiber, J., & Asner-Self, K. (2011). Educational research. John Wiley & Sons, Inc.
Tai, T.-Y., & Chen, H. H.-J. (2023). The impact of Google Assistant on adolescent EFL learners’ willingness to communicate. Interactive Learning Environments, 31(3), 1485–1502.
Thao, T. Q., & Nguyet, D. T. N. (2019). Four aspects of English speaking difficulties encountered by tertiary English-majored students. Ho Chi Minh City Open University Journal of Science, 9(2), 53-64. https://doi.org/10.46223/HCMCOUJS.soci.en.9.2.261.2019
Trofimovich, P., Isaacs, T., Kennedy, S., Saito, K., & Crowther, D. (2016). Flawed self-assessment: Investigating self- and other-perception of second language speech. Bilingualism: Language and Cognition, 19(1), 122–140. https://doi.org/10.1017/S1366728914000832
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University press.
Walker, A., & White, G. (2013). Technology enhanced language learning: Connecting theory and Practice-Oxford handbooks for language teachers. Oxford University Press. https://doi.org/10.1093/elt/cct069
Wang, Z. (2014). Developing accuracy and fluency in spoken English of Chinese EFL learners. English Language Teaching, 7(2), 110-118. https://doi.org/10.5539/elt.v7n2p110
Xie, Y., Chen, Y., & Ryder, L. H. (2021). Effects of using mobile-based virtual reality on Chinese L2 students’ oral proficiency. Computer Assisted Language Learning, 34(3), 225–245. https://doi.org/10.1080/09588221.2019.1604551
Zhang, J., Liao, Q., Li, L., & Luo, J. (2026). The influence of natural language processing on EFL speaking skills: Investigating learner adaptability, language accuracy, and fluency. Journal of Educational Computing Research, 64(1), 59-91. https://doi.org/10.1177/07356331251377414
Zou, B., Du, Y., Wang, Z., Chen, J., & Zhang, W. (2023). An investigation into artificial intelligence speech evaluation programs with automatic feedback for developing EFL learners’ speaking skills. Sage Open, 13(3), Article 21582440231193818. https://doi.org/10.1177/21582440231193818
Downloads
This work is licensed under a Creative Commons Attribution 4.0 International License.
The copyright of all articles published in the International Journal of Language Instruction (ijli) remains with the Authors, i.e. Authors retain full ownership of their article. Permitted third-party reuse of the open access articles is defined by the applicable Creative Commons (CC) end-user license which is accepted by the Authors upon submission of their paper. All articles in the ijli are published under the CC BY-NC 4.0 license, meaning that end users can freely share an article (i.e. copy and redistribute the material in any medium or format) and adapt it (i.e. remix, transform and build upon the material) on the condition that proper attribution is given (i.e. appropriate credit, a link to the applicable license and an indication if any changes were made; all in such a way that does not suggest that the licensor endorses the user or the use) and the material is only used for non-commercial purposes.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository, in a journal or publish it in a book), with an acknowledgment of its initial publication in this journal.
