ENHANCING EFL ORAL ASSESSMENT: IMPLEMENTING GENERATIVE AI FOR POETRY RECITATION EVALUATION
DOI:
https://doi.org/10.51878/cendekia.v6i3.10634Keywords:
Generative Artificial Intelligence, EFL Assessment, Poetry Recitation, Oral Proficiency, AI-Supported FeedbackAbstract
The integration of Generative Artificial Intelligence (GAI) in language education offers innovative opportunities for assessment, particularly in evaluating oral and expressive skills. This study investigates the application of GAI-supported assessment in a university-level English as a Foreign Language (EFL) class, focusing on students’ poetry recitation videos. A total of 69 students participated by submitting video recordings of their recitations, which were evaluated using a rubric-based scoring system enhanced with AI analysis. Quantitative results indicated that AI-assisted assessments were consistent and closely aligned with instructor evaluations, demonstrating high reliability in scoring pronunciation, fluency, intonation, and expressiveness. Qualitative analysis of student perceptions revealed that AI feedback was perceived as informative, motivating, and useful for improving oral performance, though some students noted limitations in capturing interpretive nuances. The findings suggest that GAI can effectively support EFL oral assessment, providing timely and reliable feedback while complementing traditional instructor evaluation. Implications for pedagogical practice, curriculum design, and future research in AI-assisted language learning are discussed.
ABSTRAK
Integrasi Generative Artificial Intelligence (GAI) dalam pendidikan bahasa menawarkan peluang inovatif untuk penilaian, khususnya dalam mengevaluasi keterampilan lisan dan ekspresif. Penelitian ini menyelidiki penerapan penilaian berbantuan GAI dalam kelas Bahasa Inggris sebagai bahasa asing (EFL) tingkat universitas, dengan fokus pada video pembacaan puisi mahasiswa. Sebanyak 69 mahasiswa berpartisipasi dengan mengumpulkan rekaman video pembacaan mereka, yang kemudian dievaluasi menggunakan sistem penilaian berbasis rubrik yang ditingkatkan dengan analisis AI. Hasil kuantitatif menunjukkan bahwa penilaian berbantuan AI konsisten dan sangat selaras dengan penilaian dosen, menunjukkan reliabilitas tinggi dalam menilai pelafalan, kelancaran, intonasi, dan ekspresivitas. Analisis kualitatif terhadap persepsi mahasiswa mengungkapkan bahwa umpan balik dari AI dipandang informatif, memotivasi, dan bermanfaat untuk meningkatkan performa lisan, meskipun beberapa mahasiswa mencatat keterbatasan dalam menangkap nuansa interpretatif. Temuan ini menunjukkan bahwa GAI dapat secara efektif mendukung penilaian lisan EFL, dengan memberikan umpan balik yang cepat dan andal serta melengkapi evaluasi tradisional oleh dosen. Implikasi terhadap praktik pedagogis, desain kurikulum, dan penelitian masa depan dalam pembelajaran bahasa berbantuan AI turut dibahas.
Downloads
References
Abdelhalim, S. M., & Alsehibany, R. A. (2025). Integrating AI-powered tools in EFL pronunciation instruction: effects on accuracy and L2 motivation. Computer Assisted Language Learning, 1-25. https://doi.org/10.1080/09588221.2025.2534015
Andrade, H. G. (2005). Teaching With Rubrics: The Good, the Bad, and the Ugly. College Teaching, 53(1), 27–31. https://doi.org/10.3200/CTCH.53.1.27-31
Black, P., & Wiliam, D. (1998). Assessment and Classroom Learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. https://doi.org/10.1080/0969595980050102
Brown, H. D. (2010). Language Assessment: Principles and Classroom Practices. Pearson.
Burton, J. (2026). Translingual spoken word poetry in an online English for academic purposes class. The Language Learning Journal, 54(2), 302–316. https://doi.org/10.1080/09571736.2026.2628332
Deveci, C. (2026). Comparing Human and AI Judgments of Turkish EFL Learners’ Intelligibility. Journal of Uludag University Faculty of Education, 39(1), 33-49. https://doi.org/10.19171/uefad.1728485
Goh, C. C., & Aryadoust, V. (2025). Developing and assessing second language listening and speaking: Does AI make it better?. Annual Review of Applied Linguistics, 1-21. https://doi.org/10.1017/S0267190525100111
Harris, D. P. (1969). Testing English as a Second Language. McGraw-Hill Book
Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education promises and implications for teaching and learning. Center for Curriculum Redesign.
Holmes, Wayne., & Luckin, Rose. (2016). Intelligence unleashed : an argument for AI in education. Pearson : UCL Knowledge Lab.
Ji, D. (2026). The impact of transformer-based chatbots on second language speaking competence in blended learning. Discover Computing, 29(1), 145. https://doi.org/10.1007/s10791-026-10035-x
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for Language Teaching and Learning. RELC Journal, 54(2), 537–550. https://doi.org/10.1177/00336882231162868
Kuddus, K. (2022). Artificial Intelligence in Language Learning: Practices and Prospects. In Advanced Analytics and Deep Learning Models (pp. 1–17). Wiley. https://doi.org/10.1002/9781119792437.ch1
Lee, Y. J. J., & Liu, Y. T. (2022). Promoting oral presentation skills through drama-based tasks with an authentic audience: A longitudinal study. The Asia-Pacific Education Researcher, 31(3), 253-267. https://doi.org/10.1007/s40299-021-00557-x
Liu, Y., binti Ab Rahman, F., & binti Mohamad Zain, F. (2025). A systematic literature review of research on automatic speech recognition in EFL pronunciation. Cogent Education, 12(1). https://doi.org/10.1080/2331186X.2025.2466288
Lun, C. W. W., Pau, L. C., & Yunus, M. M. (2026). The Impact of Popular Artificial Intelligence Tools on English Language Teaching and Learning: A Systematic Literature Review (2021-2025). International Journal of Research and Innovation in Social Science (IJRISS), 9(12). https://dx.doi.org/10.47772/IJRISS.2025.91200296
Ramos-Saltos, L. A., Vélez-Olvera, E. R., Piña-Roldán, V. A., & Pereira-Loor, J. M. (2026). AI-Enhanced Speaking Practice in Upper-Secondary EFL Classroom: A Systematic Review of Recent Evidence. Revista Científica Ciencia y Método, 4(1), 516-532. https://doi.org/10.55813/gaea/rcym/v4/n1/168
Rasinski, T. V. (2010). The fluent reader: Oral & silent reading strategies for building fluency, word recognition & comprehension. Scholastic.
Sadler, D. R. (2005). Interpretations of criteria?based assessment and grading in higher education. Assessment & Evaluation in Higher Education, 30(2), 175–194. https://doi.org/10.1080/0260293042000264262
Santoso, K. H., Al Faruq, M. S., Kurniawati, K., Hidayati, S. P., & Aung, Y. M. M. (2025). Leveraging Chatgpt's Advanced Voice Mode For Enhancing Oral-Aural Skills In Higher Education Language Learning: A Mixed-Methods Study. Improvement: Jurnal Ilmiah untuk Peningkatan Mutu Manajemen Pendidikan, 12(2), 115-124. https://doi.org/10.21009/improvement.v12i2.62614
Shaheed, A., Alam, I., & Al-Hamzi, M. A. (2026). Phonetics In Digital Language Learning: A Systematic Review Of ELT Research (2020–2025). Journal of Applied Linguistics and TESOL (JALT), 9(1), 40-56. https://doi.org/10.63878/jalt1729
Spolin, V. (1999). Improvisation for the theater: A handbook of teaching and directing techniques. Northwestern University Press.
Sun, W. (2023). The impact of automatic speech recognition technology on second language pronunciation and speaking skills of EFL learners: a mixed methods investigation. Frontiers in psychology, 14, 1210187. https://doi.org/10.3389/fpsyg.2023.1210187
Vygotsky, L. S. (1980). Mind in society: The development of higher psychological processes (M. Cole, V. John-Steiner, S. Scribner, & E. Souberman, Eds.). Harvard University Press.
Xodabande, I., Shiri, S., & Zohrabi, M. (2025). Exploring the impacts of an AI-driven instructional intervention on Iranian EFL learners’ pronunciation skill development. Discover Education, 4(1), 307. https://doi.org/10.1007/s44217-025-00782-2
Xue, S., Gao, X., Wu, Y., Sun, J., Yang, W., Li, X., ... & Chen, S. (2025). Effects of Theme, Form, and Language on Poetry Reading: Evidence From Chinese ESL Learners. Empirical Studies of the Arts, 43(1), 672-706. https://doi.org/10.1177/02762374241265866
Zou, B., Liviero, S., Hao, M., & Wei, C. (2020). Artificial Intelligence Technology for EAP Speaking Skills: Student Perceptions of Opportunities and Challenges (pp. 433–463). https://doi.org/10.1007/978-3-030-34212-8_17
